00000001:02000400:2.0F:1782216749.382330:0:2956:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg319-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1782216768.517852:0:3177:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg319-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1782216770.603436:0:3240:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 867 MB/s 00000001:01000000:3.0F:1782216770.855662:0:3240:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 675 MB/s 00000001:01000000:1.0F:1782216771.106095:0:3240:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3435 MB/s 00000020:02000000:2.0:1782216771.813664:0:3269:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_83_gf3505cf 00000400:02000000:2.0:1782216772.663944:0:3284:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.203.119@tcp [8/256/0/180] 00008000:02000000:0.0:1782216776.333626:0:3434:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1782216820.735470:0:5236:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg319-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1782216828.437453:0:5764:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1782216828.437458:0:5764:0:(obd_mount.c:917:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1782216828.437566:0:5764:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000d7af1975 00000080:02000400:0.0:1782216828.437577:0:5764:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1782216828.442482:0:5764:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1782216828.442496:0:5764:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1782216828.442533:0:5764:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000560081a4) 00000020:00000080:0.0:1782216828.442552:0:5764:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1782216828.456796:0:5764:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1782216828.457486:0:5764:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1782216828.475749:0:5764:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1782216828.475792:0:5764:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1782216828.475815:0:5764:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1782216828.475907:0:5764:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1782216828.475941:0:5764:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1782216828.476474:0:5764:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1782216828.476481:0:5764:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1782216828.476491:0:5764:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf210a9075089e815 00000020:01000004:1.0:1782216828.476498:0:5764:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1782216828.476503:0:5764:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1782216828.476507:0:5764:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d7af1975 from MGS 00000020:01000004:1.0:1782216828.476511:0:5764:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1782216828.476530:0:5764:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000059a2daa9) 00000020:00000080:1.0:1782216828.476540:0:5764:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1782216828.476602:0:5764:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d7af1975 from MGS, refs=2 00080000:01000000:1.0:1782216828.476607:0:5764:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1782216828.476613:0:5764:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf210a9075089e823 00000100:00100000:1.0:1782216828.476797:0:5764:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1782216828.476996:0:5764:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1782216828.477002:0:5764:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1782216828.477538:0:5764:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1782216828.477544:0:5764:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1782216828.478445:0:5764:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782216828.478583:0:5764:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1782216828.478589:0:5764:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1782216828.479416:0:5764:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1782216828.479431:0:5764:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1782216828.479811:0:5764:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1782216828.479822:0:5764:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1782216828.480453:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216828.480456:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216828.480457:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216828.480765:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216828.480768:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216828.480770:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216828.481494:0:5764:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1782216828.484121:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1782216828.730903:0:5764:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4003 MB/s 00000001:01000000:3.0:1782216828.980924:0:5764:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3795 MB/s 00000001:01000000:0.0:1782216829.232176:0:5764:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 589 MB/s 00000001:01000000:3.0:1782216829.484507:0:5764:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 654 MB/s 00080000:10000000:0.0:1782216829.495092:0:5764:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:0.0:1782216829.507992:0:5764:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1782216829.508009:0:5764:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1782216829.508012:0:5764:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1782216829.511035:0:5774:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1782216829.511769:0:5764:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1782216829.511816:0:5764:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1782216829.512104:0:5764:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1782216829.512132:0:5764:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1782216829.512446:0:5764:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782216829.512600:0:5764:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1782216829.512606:0:5764:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1782216829.513695:0:5764:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1782216829.513706:0:5764:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1782216829.518295:0:5764:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1782216829.518308:0:5764:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:3.0:1782216829.521496:0:5779:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1782216829.521519:0:5764:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1782216829.521540:0:5764:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.203.119@tcp' 00000020:01000004:1.0:1782216829.521542:0:5764:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1782216829.521589:0:5764:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.203.119@tcp (typ=mgc) 00000020:00000080:1.0:1782216829.521601:0:5764:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.119@tcp (0000000009739db2) 00000020:00000080:1.0:1782216829.521617:0:5764:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1782216829.521702:0:5764:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000042373bd7@MGC192.168.203.119@tcp: add connection 192.168.203.119@tcp at head 00010000:00010000:1.0:1782216829.521948:0:5764:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.119@tcp-0 is initialized 00000040:01000000:1.0:1782216829.521955:0:5764:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.119@tcp ctxt 1 is initialized 10000000:01000000:3.0:1782216829.523935:0:5780:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00010000:00010000:1.0:1782216829.525915:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782216829.525963:0:5764:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.119@tcp (uuid 526a4802-b871-4bcf-870f-067f11655366) 00000020:00000080:1.0:1782216829.525983:0:5764:0:(genops.c:1406:class_connect()) connect: client 526a4802-b871-4bcf-870f-067f11655366, cookie 0xf210a9075089e831 00000100:00080000:1.0:1782216829.525994:0:5764:0:(import.c:512:import_select_connection()) MGC192.168.203.119@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782216829.525999:0:5764:0:(import.c:626:import_select_connection()) MGC192.168.203.119@tcp: import 0000000042373bd7 using connection 192.168.203.119@tcp/0@lo 00000100:00100000:1.0:1782216829.527208:0:5764:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f3fe1c70 x1868789733916800/t0(0) o250->MGC192.168.203.119@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782216829.527238:0:5764:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import 526a4802-b871-4bcf-870f-067f11655366->MGS 00000020:01000004:1.0:1782216829.527258:0:5764:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1782216829.527264:0:5764:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1782216829.527277:0:5764:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000009f696753) 00000020:00000080:1.0:1782216829.527292:0:5764:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1782216829.529302:0:3300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000f3fe1c70 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:526a4802-b871-4bcf-870f-067f11655366:3300:1868789733916800:0@lo:250: 00000100:00100000:0.0:1782216829.529403:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216829.529484:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733916800 00000100:00100000:0.0:1782216829.529491:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733916800 00000100:00100000:0.0:1782216829.529518:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782216829.529524:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e704fd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3300:x1868789733916800:12345-0@lo:250: 00010000:00080000:0.0:1782216829.529546:0:5775:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 526a4802-b871-4bcf-870f-067f11655366@0@lo t0 exp 0000000000000000 cur 148 last 0 00000020:00000080:0.0:1782216829.529569:0:5775:0:(genops.c:1406:class_connect()) connect: client 526a4802-b871-4bcf-870f-067f11655366, cookie 0xf210a9075089e83f 00000100:00080000:0.0:1782216829.530256:0:5775:0:(import.c:65:import_set_state_nolock()) 0000000038c9d4f3 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782216829.530321:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e704fd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+5:3300:x1868789733916800:12345-0@lo:250: Request processed in 796us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216829.530330:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782216829.530755:0:3300:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.203.119@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1782216829.530765:0:3300:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.203.119@tcp: connect to target with instance 0 00000100:00080000:0.0:1782216829.530774:0:3300:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.203.119@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1782216829.530778:0:3300:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1782216829.530782:0:3300:0:(import.c:65:import_set_state_nolock()) 0000000042373bd7 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1782216829.530784:0:3300:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1782216829.530796:0:3300:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1782216829.530801:0:3300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000f3fe1c70 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:526a4802-b871-4bcf-870f-067f11655366:3300:1868789733916800:0@lo:250: 00000100:00100000:1.0:1782216829.539816:0:5764:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782216829.540158:0:5764:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1782216829.540166:0:5764:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1782216829.542731:0:5764:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1782216829.542743:0:5764:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1782216829.547514:0:5764:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1782216829.547526:0:5764:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1782216829.548548:0:5764:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782216829.548707:0:5764:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1782216829.548712:0:5764:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1782216829.551501:0:5764:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1782216829.551514:0:5764:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1782216829.593189:0:5764:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782216829.593365:0:5764:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1782216829.593371:0:5764:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1782216829.594368:0:5764:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1782216829.594376:0:5764:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1782216829.595065:0:5764:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782216829.595210:0:5764:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1782216829.595214:0:5764:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1782216829.595580:0:5764:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1782216829.595592:0:5764:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1782216829.596715:0:5764:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782216829.596840:0:5764:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1782216829.596845:0:5764:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1782216829.597353:0:5764:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1782216829.597358:0:5764:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1782216829.598049:0:5764:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782216829.598207:0:5764:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1782216829.598212:0:5764:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1782216829.598737:0:5764:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1782216829.598744:0:5764:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1782216829.624636:0:5764:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782216829.625232:0:5764:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1782216829.625239:0:5764:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1782216829.632341:0:5764:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1782216829.632358:0:5764:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1782216829.633423:0:5764:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1782216829.633433:0:5764:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1782216829.635216:0:5764:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1782216829.635243:0:5764:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1782216829.635248:0:5764:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.119@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1782216829.635369:0:5764:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.119@tcp ctxt 0 is initialized 00000020:01000004:1.0:1782216829.635401:0:5764:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.119@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1782216829.635405:0:5764:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1782216829.635407:0:5764:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1782216829.635408:0:5764:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782216829.635409:0:5764:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782216829.635410:0:5764:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782216829.635411:0:5764:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782216829.635412:0:5764:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782216829.635413:0:5764:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1782216829.635414:0:5764:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782216829.635415:0:5764:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782216829.635417:0:5764:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782216829.635418:0:5764:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1782216829.635420:0:5764:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1782216829.635422:0:5764:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1782216829.635424:0:5764:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1782216829.635425:0:5764:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782216829.635426:0:5764:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782216829.635427:0:5764:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782216829.635428:0:5764:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782216829.635429:0:5764:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782216829.635430:0:5764:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1782216829.635434:0:5764:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782216829.635435:0:5764:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782216829.635436:0:5764:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782216829.635437:0:5764:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1782216829.635460:0:5764:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1782216829.635475:0:5764:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000085d1f3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:5764:1868789733916928:0@lo:253: 00000100:00100000:1.0:1782216829.635547:0:5764:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216829.635635:0:5764:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b80e564c going to sleep for 11 seconds 00000100:00100000:3.0:1782216829.635743:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733916928 00000100:00100000:3.0:1782216829.635750:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733916928 00000100:00100000:3.0:1782216829.635803:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782216829.635811:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058baaecc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+5:5764:x1868789733916928:12345-0@lo:253: 20000000:01000000:3.0:1782216829.635852:0:5778:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1782216829.635854:0:5778:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1782216829.636240:0:5799:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1782216829.636331:0:5778:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1782216829.636641:0:5778:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782216829.639823:0:5800:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1782216829.644177:0:5778:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1782216829.644184:0:5778:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1782216829.644190:0:5778:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1782216829.644192:0:5778:0:(mgs_llog.c:3603:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1782216829.644208:0:5778:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1782216829.644424:0:5778:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782216829.644637:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1782216829.644649:0:5778:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1782216829.644720:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1782216829.644778:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1782216829.644814:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1782216829.646318:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1782216829.646348:0:5778:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1782216829.646410:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1782216829.646416:0:5778:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1782216829.646440:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1782216829.646446:0:5778:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1782216829.646468:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1782216829.646507:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1782216829.646554:0:5778:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1782216829.646559:0:5778:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1782216829.646569:0:5778:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782216829.646800:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1782216829.646811:0:5778:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1782216829.646846:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1782216829.646902:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1782216829.646951:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1782216829.646964:0:5778:0:(mgs_llog.c:3120:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1782216829.647041:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1782216829.647049:0:5778:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1782216829.647093:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1782216829.647131:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1782216829.647166:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1782216829.647176:0:5778:0:(mgs_llog.c:3085:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1782216829.647291:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1782216829.647302:0:5778:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1782216829.647337:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1782216829.647374:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1782216829.647541:0:5778:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1782216829.647597:0:5778:0:(mgs_llog.c:3300:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1782216829.647605:0:5778:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1782216829.649026:0:5801:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1782216829.649446:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1782216829.649473:0:5778:0:(mgs_llog.c:3346:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.119@tcp for mdt 20000000:01000000:0.0:1782216829.649475:0:5778:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.119@tcp (null) (null) (null) 00000040:00080000:0.0:1782216829.649511:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1782216829.649519:0:5778:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1782216829.649546:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1782216829.649553:0:5778:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.119@tcp (null) (null) 00000040:00080000:0.0:1782216829.649593:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1782216829.649603:0:5778:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1782216829.649637:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1782216829.649690:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1782216829.650372:0:5778:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1782216829.650377:0:5778:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1782216829.650382:0:5778:0:(mgs_llog.c:5063:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1782216829.650389:0:5778:0:(mgs_llog.c:1376:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1782216829.650869:0:5802:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:0.0:1782216829.651229:0:5778:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1782216829.663843:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1782216829.663929:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:0.0:1782216829.664012:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:0.0:1782216829.664031:0:5778:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1782216829.664034:0:5778:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1782216829.664038:0:5778:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1782216829.664051:0:5778:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1782216829.664054:0:5778:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1782216829.664086:0:5778:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1782216829.664089:0:5778:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1782216829.666255:0:5803:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:3.0:1782216829.666577:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:3.0:1782216829.666624:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:3.0:1782216829.666723:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:3.0:1782216829.666739:0:5778:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1782216829.666742:0:5778:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1782216829.671147:0:5804:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1782216829.671559:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1782216829.671608:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1782216829.671644:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1782216829.671670:0:5778:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1782216829.671673:0:5778:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:3.0:1782216829.671683:0:5778:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1782216829.671704:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000083ee786e/0xf210a9075089e846 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216829.671719:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000083ee786e/0xf210a9075089e846 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216829.671728:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000083ee786e/0xf210a9075089e846 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216829.671733:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000083ee786e/0xf210a9075089e846 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216829.671739:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000083ee786e/0xf210a9075089e846 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216829.671745:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000083ee786e/0xf210a9075089e846 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216829.671751:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000083ee786e already unused, calling callback (00000000620702f5) 00010000:00010000:3.0:1782216829.671754:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000083ee786e/0xf210a9075089e846 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216829.671761:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000083ee786e/0xf210a9075089e846 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216829.671788:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000083ee786e/0xf210a9075089e846 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216829.671795:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000083ee786e/0xf210a9075089e846 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216829.671800:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000083ee786e/0xf210a9075089e846 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1782216829.671816:0:5778:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1782216829.844923:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058baaecc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+5:5764:x1868789733916928:12345-0@lo:253: Request processed in 209106us (209369us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216829.844938:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782216829.845064:0:5764:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000085d1f3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:5764:1868789733916928:0@lo:253: 10000000:01000000:1.0:1782216829.845079:0:5764:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1782216829.845082:0:5764:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782216829.845084:0:5764:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1782216829.845085:0:5764:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782216829.845086:0:5764:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1782216829.845088:0:5764:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782216829.845089:0:5764:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782216829.845090:0:5764:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782216829.845092:0:5764:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1782216829.845093:0:5764:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1782216829.845095:0:5764:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782216829.845096:0:5764:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1782216829.845114:0:5764:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d7af1975 from lustre-MDT0000 10000000:01000000:1.0:1782216829.845136:0:5764:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1782216829.845139:0:5764:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1782216829.845144:0:5764:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff88e6484dcd40 10000000:01000000:1.0:1782216829.845148:0:5764:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782216829.845155:0:5764:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff88e6484dcd40 from 1 10000000:01000000:1.0:1782216829.845158:0:5764:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1782216829.845192:0:5764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: 000000000d11b0ba/0xf210a9075089e84d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216829.845203:0:5764:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: 000000000d11b0ba/0xf210a9075089e84d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216829.845223:0:5764:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: 000000000d11b0ba/0xf210a9075089e84d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216829.845241:0:5764:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000085d1f3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:5764:1868789733917056:0@lo:101: 00000100:00100000:1.0:1782216829.845284:0:5764:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216829.845346:0:5764:0:(client.c:2701:ptlrpc_set_wait()) set 00000000488fcf75 going to sleep for 11 seconds 00000100:00100000:0.0:1782216829.845408:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733917056 00000100:00100000:0.0:1782216829.845419:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733917056 00000100:00100000:0.0:1782216829.845459:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782216829.845469:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a9bf9184 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+5:5764:x1868789733917056:12345-0@lo:101: 00010000:00010000:0.0:1782216829.845482:0:5775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216829.845495:0:5775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002fc7bff0/0xf210a9075089e854 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089e84d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216829.845515:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002fc7bff0/0xf210a9075089e854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089e84d expref: 6 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216829.845524:0:5775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002fc7bff0/0xf210a9075089e854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089e84d expref: 6 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216829.845533:0:5775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002fc7bff0, rc 0) 00000100:00100000:0.0:1782216829.845569:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a9bf9184 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+6:5764:x1868789733917056:12345-0@lo:101: Request processed in 103us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216829.845576:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782216829.845649:0:5764:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000085d1f3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:5764:1868789733917056:0@lo:101: 00010000:00010000:1.0:1782216829.845671:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: 000000000d11b0ba/0xf210a9075089e84d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e854 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216829.845679:0:5764:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: 000000000d11b0ba/0xf210a9075089e84d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089e854 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216829.845718:0:5764:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000085d1f3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:5764:1868789733917184:0@lo:501: 00000100:00100000:1.0:1782216829.845742:0:5764:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216829.845755:0:5764:0:(client.c:2701:ptlrpc_set_wait()) set 00000000488fcf75 going to sleep for 11 seconds 00000100:00100000:3.0:1782216829.845809:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733917184 00000100:00100000:3.0:1782216829.845813:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733917184 00000100:00100000:3.0:1782216829.845843:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782216829.845849:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021c3e2b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+6:5764:x1868789733917184:12345-0@lo:501: 00000100:00100000:3.0:1782216829.846072:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021c3e2b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+6:5764:x1868789733917184:12345-0@lo:501: Request processed in 223us (329us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782216829.846079:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782216829.846152:0:5764:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000085d1f3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:5764:1868789733917184:0@lo:501: 10000000:01000000:1.0:1782216829.846173:0:5764:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1782216829.846189:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: 000000000d11b0ba/0xf210a9075089e84d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e854 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216829.846197:0:5764:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: 000000000d11b0ba/0xf210a9075089e84d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e854 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782216829.846204:0:5764:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88e650a2a800 10000000:01000000:1.0:1782216829.846208:0:5764:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1782216829.846217:0:5764:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff88e650a2a800 10000000:01000000:1.0:1782216829.846220:0:5764:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1782216829.846223:0:5764:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff88e650a2a800 from 1 10000000:01000000:1.0:1782216829.846225:0:5764:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1782216829.846240:0:5764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: 000000000edc1058/0xf210a9075089e85b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216829.846247:0:5764:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: 000000000edc1058/0xf210a9075089e85b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216829.846254:0:5764:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: 000000000edc1058/0xf210a9075089e85b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216829.846265:0:5764:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000085d1f3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:5764:1868789733917312:0@lo:101: 00000100:00100000:1.0:1782216829.846288:0:5764:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216829.846317:0:5764:0:(client.c:2701:ptlrpc_set_wait()) set 00000000488fcf75 going to sleep for 11 seconds 00000100:00100000:3.0:1782216829.846409:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733917312 00000100:00100000:3.0:1782216829.846414:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733917312 00000100:00100000:3.0:1782216829.846443:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782216829.846450:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b242c11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+6:5764:x1868789733917312:12345-0@lo:101: 00010000:00010000:3.0:1782216829.846457:0:5775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782216829.846465:0:5775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000083ee786e/0xf210a9075089e862 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089e85b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216829.846490:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000083ee786e/0xf210a9075089e862 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089e85b expref: 7 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216829.846498:0:5775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000083ee786e/0xf210a9075089e862 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089e85b expref: 7 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216829.846505:0:5775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000083ee786e, rc 0) 00000100:00100000:3.0:1782216829.846540:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b242c11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+7:5764:x1868789733917312:12345-0@lo:101: Request processed in 91us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216829.846546:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782216829.846662:0:5764:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000085d1f3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:5764:1868789733917312:0@lo:101: 00010000:00010000:1.0:1782216829.846671:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: 000000000edc1058/0xf210a9075089e85b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e862 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216829.846677:0:5764:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: 000000000edc1058/0xf210a9075089e85b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089e862 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782216829.846687:0:5764:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1782216829.846699:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: 000000000edc1058/0xf210a9075089e85b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e862 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216829.846704:0:5764:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: 000000000edc1058/0xf210a9075089e85b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e862 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782216829.846720:0:5764:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1782216829.846723:0:5764:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782216829.846727:0:5764:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff88e650a2a800 10000000:01000000:1.0:1782216829.846729:0:5764:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1782216829.846731:0:5764:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1782216829.846733:0:5764:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1782216829.846745:0:5764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: 00000000b92811ca/0xf210a9075089e869 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216829.846750:0:5764:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: 00000000b92811ca/0xf210a9075089e869 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216829.846756:0:5764:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: 00000000b92811ca/0xf210a9075089e869 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216829.846766:0:5764:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000085d1f3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:5764:1868789733917440:0@lo:101: 00000100:00100000:1.0:1782216829.846789:0:5764:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216829.846807:0:5764:0:(client.c:2701:ptlrpc_set_wait()) set 00000000488fcf75 going to sleep for 11 seconds 00000100:00100000:3.0:1782216829.846897:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733917440 00000100:00100000:3.0:1782216829.846901:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733917440 00000100:00100000:3.0:1782216829.847003:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782216829.847011:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b2e2d661 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+7:5764:x1868789733917440:12345-0@lo:101: 00010000:00010000:3.0:1782216829.847018:0:5775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782216829.847024:0:5775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d33c436c/0xf210a9075089e870 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089e869 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216829.847036:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d33c436c/0xf210a9075089e870 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089e869 expref: 8 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216829.847043:0:5775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d33c436c/0xf210a9075089e870 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089e869 expref: 8 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216829.847049:0:5775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d33c436c, rc 0) 00000100:00100000:3.0:1782216829.847083:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b2e2d661 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+8:5764:x1868789733917440:12345-0@lo:101: Request processed in 74us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216829.847089:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782216829.847156:0:5764:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000085d1f3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:5764:1868789733917440:0@lo:101: 00010000:00010000:1.0:1782216829.847166:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: 00000000b92811ca/0xf210a9075089e869 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e870 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216829.847172:0:5764:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: 00000000b92811ca/0xf210a9075089e869 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089e870 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216829.847207:0:5764:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000085d1f3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:5764:1868789733917568:0@lo:501: 00000100:00100000:1.0:1782216829.847230:0:5764:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216829.847388:0:5764:0:(client.c:2701:ptlrpc_set_wait()) set 00000000488fcf75 going to sleep for 11 seconds 00000100:00100000:0.0:1782216829.847425:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733917568 00000100:00100000:0.0:1782216829.847429:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733917568 00000100:00100000:0.0:1782216829.847449:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782216829.847454:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0dd0393 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+8:5764:x1868789733917568:12345-0@lo:501: 00000100:00100000:0.0:1782216829.847640:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0dd0393 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+9:5764:x1868789733917568:12345-0@lo:501: Request processed in 185us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216829.847647:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782216829.847731:0:5764:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000085d1f3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:5764:1868789733917568:0@lo:501: 00000100:00100000:1.0:1782216829.847757:0:5764:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000085d1f3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:5764:1868789733917696:0@lo:503: 00000100:00100000:1.0:1782216829.847793:0:5764:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216829.847813:0:5764:0:(client.c:2701:ptlrpc_set_wait()) set 00000000488fcf75 going to sleep for 11 seconds 00000100:00100000:0.0:1782216829.847864:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733917696 00000100:00100000:0.0:1782216829.847868:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733917696 00000100:00100000:0.0:1782216829.847919:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782216829.847925:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a7615c9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+9:5764:x1868789733917696:12345-0@lo:503: 00000100:00100000:0.0:1782216829.848058:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a7615c9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+9:5764:x1868789733917696:12345-0@lo:503: Request processed in 134us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216829.848070:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782216829.848148:0:5764:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000085d1f3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:5764:1868789733917696:0@lo:503: 00000100:00100000:1.0:1782216829.848621:0:5806:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000085d1f3b pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:5806:1868789733917824:0@lo:502: 00000100:00100000:1.0:1782216829.848668:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216829.848729:0:5806:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f9b2eb4d going to sleep for 11 seconds 00000100:00100000:0.0:1782216829.848765:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733917824 00000100:00100000:0.0:1782216829.848769:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733917824 00000100:00100000:0.0:1782216829.848836:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782216829.848843:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d907c8cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+9:5806:x1868789733917824:12345-0@lo:502: 00000100:00100000:0.0:1782216829.849016:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d907c8cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+9:5806:x1868789733917824:12345-0@lo:502: Request processed in 173us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216829.849023:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782216829.849090:0:5806:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000085d1f3b pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:5806:1868789733917824:0@lo:502: 00000020:01000000:1.0:1782216829.849111:0:5806:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782216829.849122:0:5806:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216829.849124:0:5806:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1782216829.849129:0:5806:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1782216829.849131:0:5806:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782216829.849144:0:5806:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000008de5ad30) 00000020:00000080:1.0:1782216829.849159:0:5806:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1782216829.849164:0:5806:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1782216829.849236:0:5806:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:1.0:1782216829.849242:0:5806:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf210a9075089e87e 00000020:00000080:1.0:1782216829.849462:0:5806:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1782216829.849466:0:5806:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782216829.849470:0:5806:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216829.849471:0:5806:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1782216829.849473:0:5806:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782216829.849476:0:5806:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216829.849477:0:5806:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1782216829.849480:0:5806:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782216829.849494:0:5806:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000b272c0ef) 00000020:00000080:1.0:1782216829.849507:0:5806:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1782216829.849511:0:5806:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1782216829.849513:0:5806:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1782216829.849515:0:5806:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1782216829.849520:0:5806:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1782216829.849563:0:5806:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d7af1975 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1782216829.849575:0:5806:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000092f27dc7) 00000020:00000080:1.0:1782216829.849582:0:5806:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1782216829.849636:0:5806:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1782216829.849641:0:5806:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf210a9075089e893 00000020:00000080:1.0:1782216829.849730:0:5806:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1782216829.849736:0:5806:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1782216829.849740:0:5806:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf210a9075089e89a 00080000:01000000:1.0:1782216829.849744:0:5806:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:1.0:1782216829.849747:0:5806:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf210a9075089e8a1 00080000:10000000:1.0:1782216829.850136:0:5806:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1782216829.850341:0:5806:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1782216829.853844:0:5806:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1782216829.928487:0:5806:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1782216829.931127:0:5806:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1782216829.935267:0:5806:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1782216829.935534:0:5806:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1782216829.978490:0:5806:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000019ad99c0) 00000020:00000080:3.0:1782216829.978513:0:5806:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1782216829.978629:0:5806:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:3.0:1782216829.978637:0:5806:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf210a9075089e8af 00000020:00000080:3.0:1782216829.980133:0:5806:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1782216829.984315:0:5806:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1782216830.031866:0:5806:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1782216830.072433:0:5806:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1782216830.100425:0:5806:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1782216830.125481:0:5806:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1782216830.148367:0:5806:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1782216830.176406:0:5806:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf210a9075089e8b6 00000020:00000080:0.0:1782216830.178739:0:5806:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1782216830.178752:0:5806:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782216830.178759:0:5806:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782216830.178761:0:5806:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1782216830.178764:0:5806:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782216830.178769:0:5806:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782216830.178770:0:5806:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1782216830.178775:0:5806:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1782216830.178815:0:5806:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1782216830.178831:0:5806:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782216830.178834:0:5806:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782216830.178836:0:5806:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1782216830.178851:0:5806:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782216830.178854:0:5806:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782216830.178855:0:5806:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782216830.178858:0:5806:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782216830.178859:0:5806:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1782216830.178936:0:5806:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004ddf75dd pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:5806:1868789733917952:0@lo:502: 00000100:00100000:0.0:1782216830.179018:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216830.179125:0:5806:0:(client.c:2701:ptlrpc_set_wait()) set 000000004975fab1 going to sleep for 11 seconds 00000100:00100000:1.0:1782216830.179254:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733917952 00000100:00100000:1.0:1782216830.179262:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733917952 00000100:00100000:1.0:1782216830.179296:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782216830.179304:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a09aeb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+9:5806:x1868789733917952:12345-0@lo:502: 00000100:00100000:1.0:1782216830.179705:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a09aeb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+9:5806:x1868789733917952:12345-0@lo:502: Request processed in 401us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216830.179713:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782216830.179951:0:5806:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004ddf75dd pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:5806:1868789733917952:0@lo:502: 00000020:01000000:0.0:1782216830.179979:0:5806:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782216830.179985:0:5806:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782216830.179987:0:5806:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:0.0:1782216830.179990:0:5806:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1782216830.180136:0:5764:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1782216830.180223:0:5764:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1782216830.180241:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: 00000000b92811ca/0xf210a9075089e869 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e870 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216830.180264:0:5764:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: 00000000b92811ca/0xf210a9075089e869 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e870 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782216830.180271:0:5764:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff88e650a2a800 from 1 10000000:01000000:1.0:1782216830.180274:0:5764:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782216830.180299:0:5764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: 00000000add9ea9c/0xf210a9075089e8bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216830.180307:0:5764:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: 00000000add9ea9c/0xf210a9075089e8bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216830.180315:0:5764:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: 00000000add9ea9c/0xf210a9075089e8bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216830.180329:0:5764:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000085d1f3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:5764:1868789733918080:0@lo:101: 00000100:00100000:1.0:1782216830.180361:0:5764:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216830.180576:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733918080 00000100:00100000:3.0:1782216830.180582:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733918080 00000100:00100000:3.0:1782216830.180621:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782216830.180627:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1c7ce6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+9:5764:x1868789733918080:12345-0@lo:101: 00010000:00010000:3.0:1782216830.180638:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782216830.180661:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001707023f/0xf210a9075089e8c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089e8bd expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216830.180684:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001707023f/0xf210a9075089e8c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089e8bd expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216830.180694:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001707023f/0xf210a9075089e8c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089e8bd expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216830.180701:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001707023f, rc 0) 00000100:00100000:3.0:1782216830.180727:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1c7ce6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+10:5764:x1868789733918080:12345-0@lo:101: Request processed in 100us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216830.180733:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782216830.180812:0:5764:0:(client.c:2701:ptlrpc_set_wait()) set 000000009d9aea95 going to sleep for 11 seconds 00000100:00100000:1.0:1782216830.180827:0:5764:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000085d1f3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:5764:1868789733918080:0@lo:101: 00010000:00010000:1.0:1782216830.180838:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: 00000000add9ea9c/0xf210a9075089e8bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e8c4 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216830.180845:0:5764:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: 00000000add9ea9c/0xf210a9075089e8bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089e8c4 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216830.181812:0:5764:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004ddf75dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:5764:1868789733918208:0@lo:256: 00000100:00100000:0.0:1782216830.181899:0:5764:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216830.181972:0:5764:0:(client.c:2701:ptlrpc_set_wait()) set 000000004975fab1 going to sleep for 11 seconds 00000100:00100000:3.0:1782216830.182008:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733918208 00000100:00100000:3.0:1782216830.182013:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733918208 00000100:00100000:3.0:1782216830.182075:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782216830.182083:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a9bf67f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+10:5764:x1868789733918208:12345-0@lo:256: 20000000:01000000:3.0:1782216830.182099:0:5778:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1782216830.182111:0:5778:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1782216830.182251:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a9bf67f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+10:5764:x1868789733918208:12345-0@lo:256: Request processed in 168us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216830.182258:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782216830.182329:0:5764:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004ddf75dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:5764:1868789733918208:0@lo:256: 10000000:01000000:2.0:1782216830.182991:0:5764:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1782216830.183011:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: 00000000add9ea9c/0xf210a9075089e8bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e8c4 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216830.183022:0:5764:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: 00000000add9ea9c/0xf210a9075089e8bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e8c4 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216830.183030:0:5764:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff88e650a2a800 from 1 10000000:01000000:2.0:1782216830.183033:0:5764:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782216830.183076:0:5764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: 00000000862c0400/0xf210a9075089e8cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216830.183083:0:5764:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: 00000000862c0400/0xf210a9075089e8cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216830.183090:0:5764:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: 00000000862c0400/0xf210a9075089e8cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216830.183103:0:5764:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008be45cbb pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:5764:1868789733918336:0@lo:101: 00000100:00100000:2.0:1782216830.183137:0:5764:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216830.183637:0:5764:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a09ef81b going to sleep for 11 seconds 00000100:00100000:0.0:1782216830.183723:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733918336 00000100:00100000:0.0:1782216830.183729:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733918336 00000100:00100000:0.0:1782216830.183759:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782216830.183766:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002dd7369 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+10:5764:x1868789733918336:12345-0@lo:101: 00010000:00010000:0.0:1782216830.183776:0:5775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216830.183787:0:5775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000035b18c2b/0xf210a9075089e8d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089e8cb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216830.183806:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000035b18c2b/0xf210a9075089e8d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089e8cb expref: 11 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216830.183813:0:5775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000035b18c2b/0xf210a9075089e8d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089e8cb expref: 11 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216830.183832:0:5775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000035b18c2b, rc 0) 00000100:00100000:0.0:1782216830.183968:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002dd7369 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+11:5764:x1868789733918336:12345-0@lo:101: Request processed in 202us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216830.183974:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782216830.186109:0:5764:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008be45cbb pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:5764:1868789733918336:0@lo:101: 00010000:00010000:2.0:1782216830.186212:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: 00000000862c0400/0xf210a9075089e8cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e8d2 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216830.186223:0:5764:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: 00000000862c0400/0xf210a9075089e8cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089e8d2 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216830.186289:0:5764:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008be45cbb pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:5764:1868789733918464:0@lo:501: 00000100:00100000:2.0:1782216830.186339:0:5764:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216830.186375:0:5764:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a09ef81b going to sleep for 11 seconds 00000100:00100000:0.0:1782216830.186441:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733918464 00000100:00100000:0.0:1782216830.186446:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733918464 00000100:00100000:0.0:1782216830.186526:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782216830.186535:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082579097 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+11:5764:x1868789733918464:12345-0@lo:501: 00000100:00100000:0.0:1782216830.187295:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082579097 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+11:5764:x1868789733918464:12345-0@lo:501: Request processed in 760us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216830.187304:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782216830.187400:0:5764:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008be45cbb pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:5764:1868789733918464:0@lo:501: 00000100:00100000:2.0:1782216830.187439:0:5764:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008be45cbb pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:5764:1868789733918592:0@lo:503: 00000100:00100000:2.0:1782216830.187488:0:5764:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216830.187783:0:5764:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a09ef81b going to sleep for 11 seconds 00000100:00100000:1.0:1782216830.187852:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733918592 00000100:00100000:1.0:1782216830.187858:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733918592 00000100:00100000:1.0:1782216830.187900:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782216830.187907:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bdc0074b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+11:5764:x1868789733918592:12345-0@lo:503: 00000040:00080000:1.0:1782216830.187949:0:5775:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782216830.187998:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bdc0074b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+11:5764:x1868789733918592:12345-0@lo:503: Request processed in 93us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216830.188004:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782216830.188086:0:5764:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008be45cbb pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:5764:1868789733918592:0@lo:503: 00000040:00080000:2.0:1782216830.189074:0:5811:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1782216830.189295:0:5764:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1782216830.189316:0:5764:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782216830.189567:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: 00000000862c0400/0xf210a9075089e8cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e8d2 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216830.189578:0:5764:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: 00000000862c0400/0xf210a9075089e8cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e8d2 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782216830.189617:0:5764:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1782216830.189620:0:5764:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88e650a2a800 10000000:01000000:1.0:1782216830.189623:0:5764:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88e650a2a800 10000000:01000000:1.0:1782216830.189626:0:5764:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782216830.189630:0:5764:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff88e650a2a800 from 1 10000000:01000000:1.0:1782216830.189632:0:5764:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782216830.189748:0:5764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: 000000001df14e5f/0xf210a9075089e8d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216830.189756:0:5764:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: 000000001df14e5f/0xf210a9075089e8d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216830.189764:0:5764:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: 000000001df14e5f/0xf210a9075089e8d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216830.189780:0:5764:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000085d1f3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:5764:1868789733918720:0@lo:101: 00000100:00100000:1.0:1782216830.189825:0:5764:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216830.190052:0:5764:0:(client.c:2701:ptlrpc_set_wait()) set 00000000fa8bcc21 going to sleep for 11 seconds 00000100:00100000:0.0:1782216830.190119:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733918720 00000100:00100000:0.0:1782216830.190125:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733918720 00000100:00100000:0.0:1782216830.190256:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782216830.190264:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027605a8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+11:5764:x1868789733918720:12345-0@lo:101: 00010000:00010000:0.0:1782216830.190277:0:5775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216830.190287:0:5775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f014dc96/0xf210a9075089e8e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089e8d9 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216830.190308:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f014dc96/0xf210a9075089e8e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089e8d9 expref: 12 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216830.190316:0:5775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f014dc96/0xf210a9075089e8e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089e8d9 expref: 12 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216830.190325:0:5775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f014dc96, rc 0) 00000100:00100000:0.0:1782216830.190364:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027605a8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+12:5764:x1868789733918720:12345-0@lo:101: Request processed in 102us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216830.190376:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782216830.190444:0:5764:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000085d1f3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:5764:1868789733918720:0@lo:101: 00010000:00010000:1.0:1782216830.190521:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: 000000001df14e5f/0xf210a9075089e8d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e8e0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216830.190529:0:5764:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: 000000001df14e5f/0xf210a9075089e8d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089e8e0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216830.190573:0:5764:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000085d1f3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:5764:1868789733918848:0@lo:501: 00000100:00100000:1.0:1782216830.190598:0:5764:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216830.190687:0:5764:0:(client.c:2701:ptlrpc_set_wait()) set 00000000fa8bcc21 going to sleep for 11 seconds 00000100:00100000:3.0:1782216830.190760:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733918848 00000100:00100000:3.0:1782216830.190765:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733918848 00000100:00100000:3.0:1782216830.190785:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782216830.190791:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020ca1c28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+12:5764:x1868789733918848:12345-0@lo:501: 00000100:00100000:3.0:1782216830.191049:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020ca1c28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+12:5764:x1868789733918848:12345-0@lo:501: Request processed in 258us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216830.191056:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782216830.191157:0:5764:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000085d1f3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:5764:1868789733918848:0@lo:501: 00000100:00100000:1.0:1782216830.191184:0:5764:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000085d1f3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:5764:1868789733918976:0@lo:503: 00000100:00100000:1.0:1782216830.191219:0:5764:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216830.191246:0:5764:0:(client.c:2701:ptlrpc_set_wait()) set 00000000fa8bcc21 going to sleep for 11 seconds 00000100:00100000:3.0:1782216830.191345:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733918976 00000100:00100000:3.0:1782216830.191349:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733918976 00000100:00100000:3.0:1782216830.191366:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782216830.191371:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f22be0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+12:5764:x1868789733918976:12345-0@lo:503: 00000100:00100000:3.0:1782216830.191667:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f22be0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+12:5764:x1868789733918976:12345-0@lo:503: Request processed in 296us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216830.191673:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782216830.191803:0:5764:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000085d1f3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:5764:1868789733918976:0@lo:503: 00000100:00100000:1.0:1782216830.192139:0:5812:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000085d1f3b pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:5812:1868789733919104:0@lo:502: 00000100:00100000:1.0:1782216830.192181:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216830.192209:0:5812:0:(client.c:2701:ptlrpc_set_wait()) set 000000009ee2d8b8 going to sleep for 11 seconds 00000100:00100000:3.0:1782216830.192305:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733919104 00000100:00100000:3.0:1782216830.192309:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733919104 00000100:00100000:3.0:1782216830.192330:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782216830.192336:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000000fc2e13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+12:5812:x1868789733919104:12345-0@lo:502: 00000100:00100000:3.0:1782216830.192584:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000000fc2e13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+12:5812:x1868789733919104:12345-0@lo:502: Request processed in 247us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216830.192591:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782216830.192679:0:5812:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000085d1f3b pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:5812:1868789733919104:0@lo:502: 00000020:01000004:1.0:1782216830.192728:0:5812:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1782216830.192743:0:5812:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000014e90af7) 00000020:00000080:1.0:1782216830.192760:0:5812:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1782216830.192927:0:5812:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d7af1975 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1782216830.192931:0:5812:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000d7af1975 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1782216830.192933:0:5812:0:(obd_mount.c:701:lustre_put_lsi()) put 00000000d7af1975 4 00010000:00080000:1.0:1782216830.192965:0:5812:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c1ac4607@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.119@tcp at head 00010000:00010000:1.0:1782216830.196130:0:5812:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1782216830.196239:0:5812:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1782216830.196275:0:5812:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1782216830.196287:0:5812:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf210a9075089e8ee 00000100:00080000:1.0:1782216830.196296:0:5812:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782216830.196300:0:5812:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c1ac4607 using connection 192.168.203.119@tcp/0@lo 00000100:00100000:1.0:1782216830.196330:0:5812:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000085d1f3b x1868789733919232/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782216830.196365:0:5812:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1782216830.197420:0:3300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000085d1f3b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1868789733919232:0@lo:38: 00000100:00100000:0.0:1782216830.197505:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216830.197567:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733919232 00000100:00100000:0.0:1782216830.197574:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733919232 00000100:00100000:0.0:1782216830.197603:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782216830.197610:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f81afe5c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3300:x1868789733919232:12345-0@lo:38: 00000100:00100000:0.0:1782216830.197669:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f81afe5c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3300:x1868789733919232:12345-0@lo:38: Request processed in 58us (165us total) trans 0 rc -11/-11 00000100:00100000:0.0:1782216830.197676:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782216830.197712:0:3300:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782216830.197719:0:3300:0:(import.c:65:import_set_state_nolock()) 00000000c1ac4607 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782216830.197722:0:3300:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1782216830.197724:0:3300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000085d1f3b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1868789733919232:0@lo:38: 00000100:00100000:0.0:1782216830.199352:0:5812:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002a593787 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:5812:1868789733919360:0@lo:502: 00000100:00100000:0.0:1782216830.199415:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216830.199447:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733919360 00000100:00100000:0.0:1782216830.199452:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733919360 00000100:00100000:0.0:1782216830.199564:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782216830.199572:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e3631d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+12:5812:x1868789733919360:12345-0@lo:502: 00000100:00100000:0.0:1782216830.199783:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e3631d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+12:5812:x1868789733919360:12345-0@lo:502: Request processed in 212us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216830.199790:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782216830.199836:0:5812:0:(client.c:2701:ptlrpc_set_wait()) set 000000004dc3f2f8 going to sleep for 11 seconds 00000100:00100000:0.0:1782216830.199855:0:5812:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002a593787 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:5812:1868789733919360:0@lo:502: 00000040:00080000:0.0:1782216830.199908:0:5812:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1782216830.200128:0:5764:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1782216830.200210:0:5764:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782216830.200260:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: 000000001df14e5f/0xf210a9075089e8d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e8e0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216830.200276:0:5764:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: 000000001df14e5f/0xf210a9075089e8d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e8e0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1782216830.200317:0:5764:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1782216830.200319:0:5764:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782216830.200321:0:5764:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782216830.200322:0:5764:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782216830.200323:0:5764:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782216830.200325:0:5764:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782216830.200326:0:5764:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782216830.200327:0:5764:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782216830.200328:0:5764:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782216830.200330:0:5764:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782216830.200331:0:5764:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782216830.200333:0:5764:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782216830.200336:0:5764:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1782216830.200338:0:5764:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782216830.200340:0:5764:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782216830.200341:0:5764:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782216830.200342:0:5764:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782216830.200343:0:5764:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782216830.200344:0:5764:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782216830.200345:0:5764:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782216830.200345:0:5764:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782216830.200346:0:5764:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782216830.200347:0:5764:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782216830.200348:0:5764:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782216830.200349:0:5764:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782216830.200372:0:5764:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1782216830.200381:0:5764:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002ec28cc2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:5764:1868789733919488:0@lo:253: 00000100:00100000:3.0:1782216830.200416:0:5764:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216830.200440:0:5764:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f27f1742 going to sleep for 11 seconds 00000100:00100000:2.0:1782216830.201558:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733919488 00000100:00100000:2.0:1782216830.201568:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733919488 00000100:00100000:2.0:1782216830.201628:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782216830.201636:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002ba7808c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+12:5764:x1868789733919488:12345-0@lo:253: 20000000:01000000:2.0:1782216830.201673:0:5776:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1782216830.201684:0:5776:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1782216830.227633:0:5776:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1782216830.227659:0:5776:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1782216830.229245:0:5799:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1782216830.229252:0:5799:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1782216830.229274:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e5efe78f/0xf210a9075089e8f5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216830.229293:0:5799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001707023f/0xf210a9075089e8c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089e8bd expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216830.229301:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e5efe78f/0xf210a9075089e8f5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216830.229338:0:5799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001707023f/0xf210a9075089e8c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf210a9075089e8bd expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216830.229351:0:5799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001707023f/0xf210a9075089e8c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf210a9075089e8bd expref: 12 pid: 5778 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216830.229365:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cae32762 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5799:1868789733919616:0@lo:104: 00000100:00100000:1.0:1782216830.229423:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216830.229488:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set 00000000fa8bcc21 going to sleep for 11 seconds 00000100:00100000:3.0:1782216830.229803:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733919616 00000100:00100000:3.0:1782216830.229816:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733919616 00000100:00100000:3.0:1782216830.229923:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782216830.229932:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a7fbf8b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:526a4802-b871-4bcf-870f-067f11655366+3:5799:x1868789733919616:12345-0@lo:104: 00010000:00010000:3.0:1782216830.229946:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.119@tcp lock: 00000000add9ea9c/0xf210a9075089e8bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089e8c4 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216830.230001:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782216830.230006:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a7fbf8b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:526a4802-b871-4bcf-870f-067f11655366+3:5799:x1868789733919616:12345-0@lo:104: Request processed in 77us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216830.230014:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1782216830.230214:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782216830.230219:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: 00000000add9ea9c/0xf210a9075089e8bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089e8c4 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216830.230226:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000add9ea9c already unused, calling callback (00000000be734bee) 10000000:00010000:2.0:1782216830.230229:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: 00000000add9ea9c/0xf210a9075089e8bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf210a9075089e8c4 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216830.230243:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: 00000000add9ea9c/0xf210a9075089e8bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf210a9075089e8c4 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782216830.230250:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: 00000000add9ea9c/0xf210a9075089e8bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf210a9075089e8c4 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216830.230256:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1782216830.230284:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: 00000000add9ea9c/0xf210a9075089e8bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e8c4 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216830.230288:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cae32762 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5799:1868789733919616:0@lo:104: 00010000:00010000:2.0:1782216830.230297:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782216830.230316:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: 00000000add9ea9c/0xf210a9075089e8bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e8c4 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216830.230323:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: 00000000add9ea9c/0xf210a9075089e8bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e8c4 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216830.230347:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216830.230349:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216830.230351:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216830.230408:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008be45cbb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:526a4802-b871-4bcf-870f-067f11655366:3302:1868789733919744:0@lo:103: 00010000:00010000:1.0:1782216830.230430:0:5799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e5efe78f/0xf210a9075089e8f5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216830.230441:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216830.230511:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733919744 00000100:00100000:0.0:1782216830.230515:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733919744 00010000:00010000:0.0:1782216830.230533:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001707023f/0xf210a9075089e8c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089e8bd expref: 13 pid: 5778 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216830.230559:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782216830.230565:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a593787 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:526a4802-b871-4bcf-870f-067f11655366+13:3302:x1868789733919744:12345-0@lo:103: 00010000:00010000:0.0:1782216830.230574:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782216830.230578:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001707023f/0xf210a9075089e8c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089e8bd expref: 13 pid: 5778 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216830.230588:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001707023f/0xf210a9075089e8c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf210a9075089e8bd expref: 13 pid: 5778 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216830.230701:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001707023f/0xf210a9075089e8c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf210a9075089e8bd expref: 13 pid: 5778 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216830.230711:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e5efe78f/0xf210a9075089e8f5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216830.230834:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e5efe78f/0xf210a9075089e8f5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782216830.230849:0:5768:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001597180s 00010000:00010000:0.0:1782216830.230852:0:5768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e5efe78f/0xf210a9075089e8f5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216830.230867:0:5768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e5efe78f/0xf210a9075089e8f5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216830.230873:0:5768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e5efe78f/0xf210a9075089e8f5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216830.230909:0:5768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e5efe78f/0xf210a9075089e8f5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216830.230916:0:5768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e5efe78f already unused, calling callback (00000000620702f5) 00010000:00010000:0.0:1782216830.230919:0:5768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e5efe78f/0xf210a9075089e8f5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216830.230926:0:5768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e5efe78f/0xf210a9075089e8f5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216830.230936:0:5768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e5efe78f/0xf210a9075089e8f5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216830.231016:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782216830.231060:0:5799:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e5efe78f/0xf210a9075089e8f5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216830.231069:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e5efe78f/0xf210a9075089e8f5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216830.231075:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e5efe78f/0xf210a9075089e8f5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216830.231916:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a593787 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:526a4802-b871-4bcf-870f-067f11655366+12:3302:x1868789733919744:12345-0@lo:103: Request processed in 1349us (1474us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216830.231925:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782216830.233418:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008be45cbb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:526a4802-b871-4bcf-870f-067f11655366:3302:1868789733919744:0@lo:103: 00000100:00100000:3.0:1782216830.234603:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002ba7808c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+11:5764:x1868789733919488:12345-0@lo:253: Request processed in 32964us (34183us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216830.234616:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782216830.234691:0:5764:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002ec28cc2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:5764:1868789733919488:0@lo:253: 10000000:01000000:0.0:1782216830.234703:0:5764:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1782216830.234706:0:5764:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782216830.234708:0:5764:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1782216830.234710:0:5764:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782216830.234711:0:5764:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782216830.234712:0:5764:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782216830.234791:0:5764:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782216830.234792:0:5764:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782216830.234794:0:5764:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1782216830.234795:0:5764:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782216830.234796:0:5764:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782216830.234798:0:5764:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782216830.234799:0:5764:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1782216830.234815:0:5764:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1782216830.240709:0:5764:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1782216830.241248:0:5764:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1782216830.241554:0:5764:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1782216830.241759:0:5764:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1782216830.241996:0:5764:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1782216830.242411:0:5764:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1782216830.243543:0:5764:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1782216830.243757:0:5764:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1782216830.243986:0:5764:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1782216830.244221:0:5764:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1782216830.244415:0:5764:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1782216830.244687:0:5764:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1782216830.279116:0:5764:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1782216830.309935:0:5764:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1782216830.310245:0:5818:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1782216830.312751:0:5764:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000020:00080000:0.0:1782216830.315037:0:5817:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1782216830.315045:0:5817:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:0.0:1782216830.315407:0:5764:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1782216830.315852:0:5764:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1782216830.315864:0:5764:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1782216830.316128:0:5764:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782216830.318470:0:5764:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1782216830.319490:0:5764:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1782216830.319532:0:5764:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1782216830.319788:0:5764:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1782216830.320222:0:5764:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1782216830.321491:0:5764:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1782216830.321645:0:5764:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1782216830.321809:0:5764:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1782216830.321967:0:5764:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1782216830.322101:0:5764:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1782216830.322264:0:5764:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1782216830.322407:0:5764:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1782216830.322582:0:5764:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1782216830.322727:0:5764:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1782216830.322898:0:5764:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1782216830.323029:0:5764:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1782216830.323184:0:5764:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1782216830.323317:0:5764:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1782216830.323479:0:5764:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1782216830.323610:0:5764:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1782216830.325084:0:5764:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1782216830.326024:0:5764:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1782216830.326195:0:5764:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1782216830.328170:0:5764:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1782216830.328546:0:5764:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1782216830.328909:0:5764:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1782216830.329207:0:5764:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1782216830.329426:0:5764:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1782216830.329872:0:5764:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1782216830.330033:0:5764:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1782216830.330185:0:5764:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1782216830.330409:0:5764:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1782216830.330976:0:5764:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1782216830.331121:0:5764:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1782216830.331346:0:5764:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1782216830.331925:0:5764:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1782216830.332091:0:5764:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1782216830.333122:0:5764:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1782216830.363116:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1782216830.412710:0:5764:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1782216830.412751:0:5764:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb4d081c67988 00100000:10000000:3.0:1782216830.412759:0:5764:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1782216830.415066:0:5764:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1782216830.415082:0:5764:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.119@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1782216830.415096:0:5764:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1782216830.415111:0:5764:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1782216830.421954:0:5818:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1782216830.422018:0:5818:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1782216830.422021:0:5818:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1782216830.548950:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216831.572226:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216832.596011:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216833.620099:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782216834.282478:0:6060:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg319-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1782216834.645757:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782216835.541738:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1782216835.541753:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1782216835.541764:0:8:0:(import.c:65:import_set_state_nolock()) 00000000c1ac4607 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782216835.541782:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c1ac4607 using connection 192.168.203.119@tcp/0@lo 00000100:00100000:0.0:1782216835.541811:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000142785dc x1868789733920000/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782216835.542030:0:3300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000142785dc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1868789733920000:0@lo:38: 00000100:00100000:3.0:1782216835.542244:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216835.542304:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782216835.542321:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000edba3777 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733919872:0@lo:400: 00000100:00100000:2.0:1782216835.542372:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216835.542453:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733920000 00000100:00100000:3.0:1782216835.542464:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733920000 00000100:00100000:0.0:1782216835.542519:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733919872 00000100:00100000:3.0:1782216835.542525:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782216835.542530:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733919872 00000100:00100000:3.0:1782216835.542537:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fbc2e7c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3300:x1868789733920000:12345-0@lo:38: 00010000:00080000:3.0:1782216835.542586:0:5785:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 154 last 0 00000100:00100000:0.0:1782216835.542592:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782216835.542607:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006e770e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+11:3304:x1868789733919872:12345-0@lo:400: 00000020:00000080:3.0:1782216835.542650:0:5785:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf210a9075089e8fc 00000100:00100000:0.0:1782216835.542677:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006e770e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+11:3304:x1868789733919872:12345-0@lo:400: Request processed in 72us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216835.542685:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000004:00100000:3.0:1782216835.542732:0:5785:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1782216835.542847:0:5785:0:(import.c:65:import_set_state_nolock()) 00000000e4844d77 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782216835.542972:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fbc2e7c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1868789733920000:12345-0@lo:38: Request processed in 436us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216835.542980:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782216835.543340:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000edba3777 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733919872:0@lo:400: 00010000:00080000:0.0:1782216835.543456:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000142785dc x1868789733920000/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782216845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1782216835.543475:0:3300:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1782216835.543485:0:3300:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1782216835.543491:0:3300:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1782216835.543494:0:3300:0:(import.c:65:import_set_state_nolock()) 00000000c1ac4607 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1782216835.543515:0:3300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000142785dc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1868789733920000:0@lo:38: 00010000:00010000:0.0:1782216835.668361:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782216836.051983:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1782216836.052003:0:5780:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff88e650a2a800 from 3 10000000:01000000:0.0:1782216836.052009:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1782216836.052076:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: 00000000e6e0616f/0xf210a9075089e903 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216836.052091:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: 00000000e6e0616f/0xf210a9075089e903 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216836.052102:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: 00000000e6e0616f/0xf210a9075089e903 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216836.052132:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000142785dc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733920128:0@lo:101: 00000100:00100000:0.0:1782216836.052224:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216836.052290:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set 000000007a116365 going to sleep for 11 seconds 00000100:00100000:3.0:1782216836.056049:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733920128 00000100:00100000:3.0:1782216836.056065:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733920128 00000100:00100000:2.0:1782216836.056276:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782216836.056290:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000018d18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+11:5780:x1868789733920128:12345-0@lo:101: 00010000:00010000:2.0:1782216836.056322:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216836.056351:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007f4814cf/0xf210a9075089e90a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089e903 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216836.056385:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007f4814cf/0xf210a9075089e90a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089e903 expref: 12 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216836.056397:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007f4814cf/0xf210a9075089e90a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089e903 expref: 12 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216836.056406:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007f4814cf, rc 0) 00000100:00100000:2.0:1782216836.056518:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000018d18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+12:5780:x1868789733920128:12345-0@lo:101: Request processed in 231us (4295us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216836.056527:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782216836.056599:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000142785dc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733920128:0@lo:101: 00010000:00010000:3.0:1782216836.056634:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: 00000000e6e0616f/0xf210a9075089e903 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e90a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216836.056648:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: 00000000e6e0616f/0xf210a9075089e903 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089e90a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216836.056733:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d884c843 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733920256:0@lo:256: 00000100:00100000:3.0:1782216836.056801:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216836.056850:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set 0000000028a3babb going to sleep for 11 seconds 00000100:00100000:0.0:1782216836.057421:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733920256 00000100:00100000:0.0:1782216836.057432:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733920256 00000100:00100000:0.0:1782216836.057486:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782216836.057494:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d64738d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+12:5780:x1868789733920256:12345-0@lo:256: 20000000:01000000:0.0:1782216836.057516:0:5778:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1782216836.057540:0:5778:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1782216836.057544:0:5778:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1782216836.057670:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d64738d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+12:5780:x1868789733920256:12345-0@lo:256: Request processed in 176us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216836.057679:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782216836.057757:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d884c843 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733920256:0@lo:256: 10000000:01000000:3.0:1782216836.057810:0:5780:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1782216836.057819:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: 00000000e6e0616f/0xf210a9075089e903 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e90a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216836.057827:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: 00000000e6e0616f/0xf210a9075089e903 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e90a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216836.697143:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216837.717504:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216838.740137:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782216839.028399:0:6262:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd0d350c70 20000000:00000080:3.0:1782216839.028427:0:6262:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88e6644d7400 uarg=0000000000000000 20000000:01000000:3.0:1782216839.028479:0:6262:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1782216839.028488:0:6262:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1782216839.028494:0:6262:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1782216839.028910:0:6262:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1782216839.028924:0:6262:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1782216839.033129:0:6262:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782216839.033444:0:6262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1782216839.033508:0:6262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1782216839.033557:0:6262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1782216839.033576:0:6262:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1782216839.033612:0:6262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000eccd78e7/0xf210a9075089e911 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216839.033635:0:6262:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000035b18c2b/0xf210a9075089e8d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089e8cb expref: 11 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216839.033644:0:6262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000eccd78e7/0xf210a9075089e911 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216839.033725:0:6262:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000035b18c2b/0xf210a9075089e8d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf210a9075089e8cb expref: 11 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216839.033744:0:6262:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000035b18c2b/0xf210a9075089e8d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf210a9075089e8cb expref: 11 pid: 5775 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216839.033762:0:6262:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d884c843 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6262:1868789733920384:0@lo:104: 00000100:00100000:3.0:1782216839.033848:0:6262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216839.033949:0:6262:0:(client.c:2701:ptlrpc_set_wait()) set 0000000028a3babb going to sleep for 11 seconds 00000100:00100000:1.0:1782216839.035939:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733920384 00000100:00100000:1.0:1782216839.035957:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733920384 00000100:00100000:1.0:1782216839.036039:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782216839.036050:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000892ecfdb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:526a4802-b871-4bcf-870f-067f11655366+3:6262:x1868789733920384:12345-0@lo:104: 00010000:00010000:1.0:1782216839.036074:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.119@tcp lock: 00000000862c0400/0xf210a9075089e8cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089e8d2 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216839.036232:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782216839.036238:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000892ecfdb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:526a4802-b871-4bcf-870f-067f11655366+3:6262:x1868789733920384:12345-0@lo:104: Request processed in 190us (2390us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216839.036246:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782216839.036260:0:6262:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d884c843 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6262:1868789733920384:0@lo:104: 00010000:00010000:1.0:1782216839.036275:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782216839.036282:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: 00000000862c0400/0xf210a9075089e8cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089e8d2 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216839.036291:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000862c0400 already unused, calling callback (00000000be734bee) 10000000:00010000:1.0:1782216839.036296:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: 00000000862c0400/0xf210a9075089e8cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf210a9075089e8d2 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216839.036299:0:6262:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000eccd78e7/0xf210a9075089e911 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216839.036305:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: 00000000862c0400/0xf210a9075089e8cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf210a9075089e8d2 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782216839.036321:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: 00000000862c0400/0xf210a9075089e8cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf210a9075089e8d2 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782216839.036329:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782216839.036371:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: 00000000862c0400/0xf210a9075089e8cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e8d2 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216839.036379:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782216839.036412:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: 00000000862c0400/0xf210a9075089e8cb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e8d2 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216839.036420:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: 00000000862c0400/0xf210a9075089e8cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e8d2 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216839.036434:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cae32762 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733920512:0@lo:103: 00010000:00010000:1.0:1782216839.036453:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216839.036456:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216839.036457:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216839.036494:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216839.036578:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733920512 00000100:00100000:1.0:1782216839.036583:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733920512 00010000:00010000:1.0:1782216839.036610:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000035b18c2b/0xf210a9075089e8d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089e8cb expref: 12 pid: 5775 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216839.036639:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782216839.036646:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000098a40fa5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:526a4802-b871-4bcf-870f-067f11655366+12:3304:x1868789733920512:12345-0@lo:103: 00010000:00010000:1.0:1782216839.036658:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782216839.036662:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000035b18c2b/0xf210a9075089e8d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089e8cb expref: 12 pid: 5775 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216839.036673:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000035b18c2b/0xf210a9075089e8d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf210a9075089e8cb expref: 12 pid: 5775 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216839.036689:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000035b18c2b/0xf210a9075089e8d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf210a9075089e8cb expref: 12 pid: 5775 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216839.036703:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000eccd78e7/0xf210a9075089e911 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216839.036712:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000eccd78e7/0xf210a9075089e911 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216839.036727:0:5769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000eccd78e7/0xf210a9075089e911 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216839.036735:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000eccd78e7/0xf210a9075089e911 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216839.036748:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000eccd78e7/0xf210a9075089e911 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216839.036754:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000eccd78e7/0xf210a9075089e911 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216839.036759:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000eccd78e7 already unused, calling callback (00000000620702f5) 00010000:00010000:1.0:1782216839.036763:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000eccd78e7/0xf210a9075089e911 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216839.036769:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000eccd78e7/0xf210a9075089e911 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216839.036778:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000eccd78e7/0xf210a9075089e911 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216839.036787:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782216839.036811:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000098a40fa5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:526a4802-b871-4bcf-870f-067f11655366+11:3304:x1868789733920512:12345-0@lo:103: Request processed in 167us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216839.036818:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1782216839.036913:0:6262:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000eccd78e7/0xf210a9075089e911 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216839.036922:0:6262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000eccd78e7/0xf210a9075089e911 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216839.036927:0:6262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000eccd78e7/0xf210a9075089e911 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216839.043078:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cae32762 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733920512:0@lo:103: 00010000:00010000:2.0:1782216839.764099:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216840.664528:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000146f752d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1868789733920768:0@lo:400: 00000100:00100000:2.0:1782216840.664614:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216840.664667:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782216840.664673:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007986a73c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:526a4802-b871-4bcf-870f-067f11655366:3302:1868789733920640:0@lo:400: 00000100:00100000:2.0:1782216840.664702:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216840.664737:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733920640 00000100:00100000:2.0:1782216840.664746:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733920640 00000100:00100000:2.0:1782216840.664787:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782216840.664811:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f96c8bfa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+11:3302:x1868789733920640:12345-0@lo:400: 00000100:00100000:2.0:1782216840.664857:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f96c8bfa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+11:3302:x1868789733920640:12345-0@lo:400: Request processed in 49us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216840.664864:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782216840.664920:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007986a73c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:526a4802-b871-4bcf-870f-067f11655366:3302:1868789733920640:0@lo:400: 00000100:00100000:2.0:1782216840.665128:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733920768 00000100:00100000:2.0:1782216840.665132:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733920768 00000100:00100000:2.0:1782216840.665159:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782216840.665165:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000007e49937 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1868789733920768:12345-0@lo:400: 00000100:00100000:2.0:1782216840.665200:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000007e49937 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1868789733920768:12345-0@lo:400: Request processed in 36us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216840.665206:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1782216840.666828:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000146f752d x1868789733920768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216840.666845:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000146f752d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1868789733920768:0@lo:400: 00010000:00010000:0.0:1782216840.788281:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216841.812049:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216842.840180:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1782216843.841689:0:6575:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1782216843.841693:0:6575:0:(obd_mount.c:917:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1782216843.841817:0:6575:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 0000000063d501a5 00000020:01000004:0.0:1782216843.841835:0:6575:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1782216843.841847:0:6575:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1782216843.841860:0:6575:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (000000003268dac5) 00000020:00000080:0.0:1782216843.841949:0:6575:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00010000:00010000:2.0:1782216843.860835:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1782216843.876941:0:6575:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1782216843.877315:0:6575:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1782216843.912157:0:6575:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1782216843.924360:0:6575:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1782216843.924396:0:6575:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1782216843.924457:0:6575:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1782216843.924485:0:6575:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1782216843.924831:0:6575:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1782216843.924842:0:6575:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1782216843.924854:0:6575:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf210a9075089e91f 00000020:01000004:3.0:1782216843.924861:0:6575:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1782216843.924910:0:6575:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.119@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1782216843.924914:0:6575:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.119@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1782216843.924920:0:6575:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1782216843.924924:0:6575:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1782216843.924935:0:6575:0:(genops.c:413:class_newdev()) Allocate new device OSS (0000000003bce917) 00000020:00000080:3.0:1782216843.924947:0:6575:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1782216843.930636:0:6575:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782216843.930798:0:6575:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1782216843.930805:0:6575:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1782216843.931113:0:6575:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1782216843.931118:0:6575:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1782216843.935678:0:6575:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1782216843.935690:0:6575:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1782216843.936841:0:6575:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782216843.937049:0:6575:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1782216843.937055:0:6575:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1782216843.937381:0:6575:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1782216843.937386:0:6575:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1782216843.991834:0:6575:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782216843.992528:0:6575:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1782216843.992536:0:6575:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1782216843.994666:0:6575:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1782216843.994680:0:6575:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1782216843.996382:0:6575:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1782216843.996396:0:6575:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1782216844.000439:0:6575:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782216844.000670:0:6575:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1782216844.000680:0:6575:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1782216844.001322:0:6575:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1782216844.001330:0:6575:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1782216844.046187:0:6575:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782216844.046362:0:6575:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1782216844.046368:0:6575:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1782216844.051065:0:6575:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1782216844.051143:0:6575:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1782216844.051773:0:6575:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1782216844.051793:0:6575:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1782216844.051798:0:6575:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.119@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1782216844.072328:0:6575:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.119@tcp ctxt 0 is initialized 00000020:01000004:3.0:1782216844.072362:0:6575:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.119@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1782216844.072366:0:6575:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1782216844.072368:0:6575:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1782216844.072370:0:6575:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782216844.072371:0:6575:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782216844.072373:0:6575:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782216844.072374:0:6575:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782216844.072375:0:6575:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782216844.072377:0:6575:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782216844.072378:0:6575:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782216844.072379:0:6575:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782216844.072380:0:6575:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782216844.072384:0:6575:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1782216844.072386:0:6575:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782216844.072387:0:6575:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1782216844.072388:0:6575:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782216844.072389:0:6575:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782216844.072390:0:6575:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782216844.072391:0:6575:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782216844.072392:0:6575:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782216844.072393:0:6575:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782216844.072394:0:6575:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782216844.072395:0:6575:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782216844.072396:0:6575:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782216844.072418:0:6575:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1782216844.072435:0:6575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ccec9960 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:6575:1868789733920896:0@lo:253: 00000100:00100000:3.0:1782216844.072507:0:6575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216844.072693:0:6575:0:(client.c:2701:ptlrpc_set_wait()) set 0000000018bd27fe going to sleep for 11 seconds 00000100:00100000:2.0:1782216844.072775:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733920896 00000100:00100000:2.0:1782216844.072783:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733920896 00000100:00100000:2.0:1782216844.072863:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782216844.072871:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c8479533 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+11:6575:x1868789733920896:12345-0@lo:253: 20000000:01000000:2.0:1782216844.072928:0:5775:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1782216844.072932:0:5775:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1782216844.072937:0:5775:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1782216844.072940:0:5775:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1782216844.073774:0:5775:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782216844.074011:0:5775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1782216844.074025:0:5775:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1782216844.074061:0:5775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1782216844.074069:0:5775:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1782216844.074114:0:5775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1782216844.074161:0:5775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1782216844.074519:0:5775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1782216844.074537:0:5775:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.203.119@tcp 20000000:01000000:2.0:1782216844.074539:0:5775:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.119@tcp (null) (null) (null) 00000040:00080000:2.0:1782216844.074585:0:5775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1782216844.074593:0:5775:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1782216844.074636:0:5775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1782216844.074644:0:5775:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.119@tcp (null) (null) 00000040:00080000:2.0:1782216844.074674:0:5775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1782216844.074682:0:5775:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1782216844.074711:0:5775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1782216844.074756:0:5775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1782216844.076824:0:5775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1782216844.076850:0:5775:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.203.119@tcp 20000000:01000000:2.0:1782216844.076855:0:5775:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.119@tcp (null) (null) (null) 00000040:00080000:2.0:1782216844.076905:0:5775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1782216844.076912:0:5775:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1782216844.076937:0:5775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1782216844.076942:0:5775:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.119@tcp (null) (null) 00000040:00080000:2.0:1782216844.076978:0:5775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1782216844.076987:0:5775:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1782216844.077017:0:5775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1782216844.077054:0:5775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1782216844.077069:0:5775:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1782216844.077072:0:5775:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1782216844.077408:0:5775:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1782216844.077411:0:5775:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1782216844.077413:0:5775:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1782216844.077424:0:5775:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1782216844.077426:0:5775:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1782216844.077458:0:5775:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1782216844.077460:0:5775:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1782216844.077865:0:6590:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1782216844.078100:0:5775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1782216844.078135:0:5775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1782216844.078183:0:5775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1782216844.078195:0:5775:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1782216844.078196:0:5775:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1782216844.078571:0:6591:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1782216844.078606:0:6591:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1782216844.078642:0:6591:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1782216844.078807:0:5775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1782216844.078836:0:5775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1782216844.078926:0:5775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1782216844.078937:0:5775:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1782216844.078939:0:5775:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1782216844.079310:0:6592:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:2.0:1782216844.079344:0:6592:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:2.0:1782216844.079381:0:6592:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1782216844.079575:0:5775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1782216844.079609:0:5775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1782216844.079644:0:5775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 10000000:01000000:3.0:1782216844.079658:0:5775:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1782216844.079673:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000eccd78e7/0xf210a9075089e92d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216844.079690:0:5775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002fc7bff0/0xf210a9075089e854 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089e84d expref: 11 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216844.079697:0:5775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d33c436c/0xf210a9075089e870 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089e869 expref: 11 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216844.079702:0:5775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f014dc96/0xf210a9075089e8e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089e8d9 expref: 11 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216844.079708:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000eccd78e7/0xf210a9075089e92d lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216844.079740:0:5775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f014dc96/0xf210a9075089e8e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf210a9075089e8d9 expref: 11 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216844.079753:0:5775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f014dc96/0xf210a9075089e8e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf210a9075089e8d9 expref: 11 pid: 5775 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216844.079765:0:5775:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000dca89790 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5775:1868789733921024:0@lo:104: 00000100:00100000:3.0:1782216844.079820:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782216844.079900:0:5775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d33c436c/0xf210a9075089e870 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf210a9075089e869 expref: 11 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216844.079907:0:5775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d33c436c/0xf210a9075089e870 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf210a9075089e869 expref: 11 pid: 5775 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216844.079914:0:5775:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b3688daa pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5775:1868789733921152:0@lo:104: 00000100:00100000:3.0:1782216844.079938:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216844.079963:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733921024 00000100:00100000:3.0:1782216844.079969:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733921024 00000100:00100000:3.0:1782216844.079996:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733921152 00000100:00100000:3.0:1782216844.079998:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733921152 00000100:00100000:3.0:1782216844.080009:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782216844.080015:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b2024e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:526a4802-b871-4bcf-870f-067f11655366+4:5775:x1868789733921024:12345-0@lo:104: 00010000:00010000:3.0:1782216844.080026:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.119@tcp lock: 000000001df14e5f/0xf210a9075089e8d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089e8e0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216844.080065:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782216844.080069:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b2024e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:526a4802-b871-4bcf-870f-067f11655366+4:5775:x1868789733921024:12345-0@lo:104: Request processed in 55us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216844.080076:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1782216844.080234:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782216844.080238:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: 000000001df14e5f/0xf210a9075089e8d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089e8e0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.080246:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001df14e5f already unused, calling callback (00000000be734bee) 10000000:00010000:2.0:1782216844.080253:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: 000000001df14e5f/0xf210a9075089e8d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf210a9075089e8e0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.080261:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: 000000001df14e5f/0xf210a9075089e8d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf210a9075089e8e0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782216844.080267:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: 000000001df14e5f/0xf210a9075089e8d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf210a9075089e8e0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216844.080273:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782216844.080294:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: 000000001df14e5f/0xf210a9075089e8d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e8e0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.080299:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782216844.080313:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: 000000001df14e5f/0xf210a9075089e8d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e8e0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.080319:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: 000000001df14e5f/0xf210a9075089e8d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e8e0 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.080329:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216844.080330:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216844.080332:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216844.080341:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000146f752d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789733921280:0@lo:103: 00000100:00100000:2.0:1782216844.080365:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216844.080402:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733921280 00000100:00100000:2.0:1782216844.080405:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733921280 00010000:00010000:2.0:1782216844.080419:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f014dc96/0xf210a9075089e8e0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089e8d9 expref: 12 pid: 5775 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216844.080436:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782216844.080447:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007986a73c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:526a4802-b871-4bcf-870f-067f11655366+12:3303:x1868789733921280:12345-0@lo:103: 00010000:00010000:2.0:1782216844.080455:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782216844.080458:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f014dc96/0xf210a9075089e8e0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089e8d9 expref: 12 pid: 5775 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.080467:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f014dc96/0xf210a9075089e8e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf210a9075089e8d9 expref: 12 pid: 5775 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.080479:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782216844.080499:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007986a73c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:526a4802-b871-4bcf-870f-067f11655366+12:3303:x1868789733921280:12345-0@lo:103: Request processed in 54us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216844.080505:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782216844.080533:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000146f752d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789733921280:0@lo:103: 10000000:01000000:1.0:1782216844.080590:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1782216844.080594:0:5780:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff88e650a2a800 from 21 10000000:01000000:1.0:1782216844.080598:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782216844.080624:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: 0000000022aa1e52/0xf210a9075089e934 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216844.080631:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: 0000000022aa1e52/0xf210a9075089e934 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216844.080646:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: 0000000022aa1e52/0xf210a9075089e934 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216844.080657:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cae32762 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733921408:0@lo:101: 00000100:00100000:1.0:1782216844.080681:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216844.080703:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set 0000000042cb612d going to sleep for 11 seconds 00010000:00010000:1.0:1782216844.080729:0:5775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002fc7bff0/0xf210a9075089e854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf210a9075089e84d expref: 11 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216844.080736:0:5775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002fc7bff0/0xf210a9075089e854 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf210a9075089e84d expref: 11 pid: 5775 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216844.080743:0:5775:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000876fbe45 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5775:1868789733921536:0@lo:104: 00000100:00100000:1.0:1782216844.080760:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216844.080775:0:5767:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1782216844.080780:0:5767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:1.0:1782216844.080865:0:5775:0:(client.c:2701:ptlrpc_set_wait()) set 0000000086ea93c8 going to sleep for 11 seconds 00010000:00010000:1.0:1782216844.080897:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f014dc96/0xf210a9075089e8e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf210a9075089e8d9 expref: 11 pid: 5775 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216844.080907:0:5775:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000dca89790 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5775:1868789733921024:0@lo:104: 00000100:00100000:1.0:1782216844.080928:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733921536 00000100:00100000:1.0:1782216844.080931:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733921536 00000100:00100000:2.0:1782216844.081076:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733921408 00000100:00100000:2.0:1782216844.081090:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733921408 00000100:00100000:2.0:1782216844.081116:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782216844.081121:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ac421f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+11:5780:x1868789733921408:12345-0@lo:101: 00010000:00010000:2.0:1782216844.081132:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216844.081139:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000009f30052/0xf210a9075089e93b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089e934 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.081152:0:5778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000eccd78e7/0xf210a9075089e92d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.081159:0:5778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000009f30052/0xf210a9075089e93b lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089e934 expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.081169:0:5778:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: MGS lock: 00000000eccd78e7/0xf210a9075089e92d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.081187:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000009f30052/0xf210a9075089e93b lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089e934 expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.081193:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000009f30052, rc 0) 00000100:00100000:2.0:1782216844.081219:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ac421f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+12:5780:x1868789733921408:12345-0@lo:101: Request processed in 99us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216844.081225:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782216844.081251:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cae32762 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733921408:0@lo:101: 00010000:00010000:2.0:1782216844.081260:0:5780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGC192.168.203.119@tcp lock: 0000000022aa1e52/0xf210a9075089e934 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e93b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.081266:0:5780:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGC192.168.203.119@tcp lock: 0000000022aa1e52/0xf210a9075089e934 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089e93b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216844.081678:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782216844.081686:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f40533ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:526a4802-b871-4bcf-870f-067f11655366+4:5775:x1868789733921152:12345-0@lo:104: 00010000:00010000:1.0:1782216844.081695:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.119@tcp lock: 00000000b92811ca/0xf210a9075089e869 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089e870 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216844.081751:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782216844.081755:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f40533ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:526a4802-b871-4bcf-870f-067f11655366+4:5775:x1868789733921152:12345-0@lo:104: Request processed in 72us (1817us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216844.081761:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782216844.081772:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782216844.081777:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e83d82fc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:526a4802-b871-4bcf-870f-067f11655366+3:5775:x1868789733921536:12345-0@lo:104: 00010000:00010000:1.0:1782216844.081782:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.119@tcp lock: 000000000d11b0ba/0xf210a9075089e84d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089e854 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216844.081804:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782216844.081807:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e83d82fc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:526a4802-b871-4bcf-870f-067f11655366+3:5775:x1868789733921536:12345-0@lo:104: Request processed in 32us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216844.081813:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1782216844.081951:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782216844.081955:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: 00000000b92811ca/0xf210a9075089e869 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089e870 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216844.081972:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b92811ca already unused, calling callback (00000000be734bee) 10000000:00010000:0.0:1782216844.081974:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: 00000000b92811ca/0xf210a9075089e869 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf210a9075089e870 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216844.081980:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: 00000000b92811ca/0xf210a9075089e869 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf210a9075089e870 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782216844.081985:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: 00000000b92811ca/0xf210a9075089e869 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf210a9075089e870 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216844.081990:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782216844.082009:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: 00000000b92811ca/0xf210a9075089e869 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e870 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216844.082014:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782216844.082030:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: 00000000b92811ca/0xf210a9075089e869 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e870 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216844.082036:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: 00000000b92811ca/0xf210a9075089e869 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e870 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216844.082055:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782216844.082056:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: 000000000d11b0ba/0xf210a9075089e84d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089e854 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216844.082061:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000d11b0ba already unused, calling callback (00000000be734bee) 10000000:00010000:0.0:1782216844.082063:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: 000000000d11b0ba/0xf210a9075089e84d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf210a9075089e854 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216844.082090:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: 000000000d11b0ba/0xf210a9075089e84d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf210a9075089e854 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782216844.082096:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: 000000000d11b0ba/0xf210a9075089e84d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf210a9075089e854 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216844.082101:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782216844.082110:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: 000000000d11b0ba/0xf210a9075089e84d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e854 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216844.082115:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782216844.082123:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: 000000000d11b0ba/0xf210a9075089e84d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e854 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216844.082128:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: 000000000d11b0ba/0xf210a9075089e84d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e854 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216844.082137:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216844.082138:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216844.082140:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216844.082309:0:5775:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b3688daa pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5775:1868789733921152:0@lo:104: 00000100:00100000:2.0:1782216844.082317:0:5775:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000876fbe45 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5775:1868789733921536:0@lo:104: 00010000:00010000:2.0:1782216844.082332:0:5775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000eccd78e7/0xf210a9075089e92d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216844.082349:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000049710d5e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:526a4802-b871-4bcf-870f-067f11655366:3301:1868789733921792:0@lo:103: 00000100:00100000:2.0:1782216844.082376:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216844.082417:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782216844.082422:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000009a853c64 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789733921664:0@lo:103: 00000100:00100000:2.0:1782216844.082438:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782216844.082453:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216844.082460:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733921792 00000100:00100000:2.0:1782216844.082468:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733921792 00010000:00010000:2.0:1782216844.082483:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002fc7bff0/0xf210a9075089e854 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089e84d expref: 12 pid: 5775 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216844.082498:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733921664 00000100:00100000:2.0:1782216844.082500:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733921664 00010000:00010000:2.0:1782216844.082506:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d33c436c/0xf210a9075089e870 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089e869 expref: 13 pid: 5775 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216844.082517:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782216844.082521:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000146f752d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:526a4802-b871-4bcf-870f-067f11655366+13:3301:x1868789733921792:12345-0@lo:103: 00010000:00010000:2.0:1782216844.082528:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782216844.082531:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002fc7bff0/0xf210a9075089e854 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089e84d expref: 13 pid: 5775 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.082538:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002fc7bff0/0xf210a9075089e854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf210a9075089e84d expref: 13 pid: 5775 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.082560:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002fc7bff0/0xf210a9075089e854 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf210a9075089e84d expref: 13 pid: 5775 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.082571:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782216844.082591:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000146f752d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:526a4802-b871-4bcf-870f-067f11655366+12:3301:x1868789733921792:12345-0@lo:103: Request processed in 70us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216844.082597:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782216844.082607:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782216844.082611:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004df8970a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:526a4802-b871-4bcf-870f-067f11655366+11:3303:x1868789733921664:12345-0@lo:103: 00010000:00010000:2.0:1782216844.082617:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782216844.082620:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d33c436c/0xf210a9075089e870 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089e869 expref: 11 pid: 5775 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.082636:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d33c436c/0xf210a9075089e870 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf210a9075089e869 expref: 11 pid: 5775 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.082645:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d33c436c/0xf210a9075089e870 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf210a9075089e869 expref: 11 pid: 5775 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.082654:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000eccd78e7/0xf210a9075089e92d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.082661:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000eccd78e7/0xf210a9075089e92d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.082671:0:5770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000eccd78e7/0xf210a9075089e92d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.082677:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000eccd78e7/0xf210a9075089e92d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.082683:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000eccd78e7/0xf210a9075089e92d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.082688:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000eccd78e7/0xf210a9075089e92d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.082693:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000eccd78e7 already unused, calling callback (00000000620702f5) 00010000:00010000:2.0:1782216844.082696:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000eccd78e7/0xf210a9075089e92d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.082701:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000eccd78e7/0xf210a9075089e92d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.082720:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000009f30052/0xf210a9075089e93b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 0@lo remote: 0xf210a9075089e934 expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.082726:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000009f30052/0xf210a9075089e93b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 0@lo remote: 0xf210a9075089e934 expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.082740:0:5770:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: MGS lock: 0000000009f30052/0xf210a9075089e93b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089e934 expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216844.082748:0:5770:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000f2b6250d pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:MGS:5770:1868789733921920:0@lo:105: 00000100:00100000:2.0:1782216844.082766:0:5770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216844.082778:0:5770:0:(client.c:2701:ptlrpc_set_wait()) set 0000000024508b6f going to sleep for 11 seconds 00010000:00010000:2.0:1782216844.082790:0:5775:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000eccd78e7/0xf210a9075089e92d lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.082797:0:5775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000eccd78e7/0xf210a9075089e92d lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1782216844.082804:0:5775:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1782216844.083211:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000049710d5e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:526a4802-b871-4bcf-870f-067f11655366:3301:1868789733921792:0@lo:103: 00000100:00100000:2.0:1782216844.083232:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733921920 00000100:00100000:2.0:1782216844.083235:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733921920 00000100:00100000:2.0:1782216844.083256:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782216844.083260:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e84fd926 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:526a4802-b871-4bcf-870f-067f11655366+3:5770:x1868789733921920:12345-0@lo:105: 00010000:00010000:2.0:1782216844.083267:0:5767:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: MGC192.168.203.119@tcp lock: 0000000022aa1e52/0xf210a9075089e934 lrc: 5/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089e93b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.083274:0:5767:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: MGC192.168.203.119@tcp lock: 0000000022aa1e52/0xf210a9075089e934 lrc: 5/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089e93b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.083285:0:5767:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGC192.168.203.119@tcp lock: 0000000022aa1e52/0xf210a9075089e934 lrc: 5/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0xf210a9075089e93b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.083290:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: 0000000022aa1e52/0xf210a9075089e934 lrc: 6/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0xf210a9075089e93b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.083295:0:5767:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: MGC192.168.203.119@tcp lock: 0000000022aa1e52/0xf210a9075089e934 lrc: 6/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1080000000000 nid: local remote: 0xf210a9075089e93b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.083308:0:5767:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock 0000000022aa1e52) 00000100:00100000:2.0:1782216844.083332:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e84fd926 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:526a4802-b871-4bcf-870f-067f11655366+3:5770:x1868789733921920:12345-0@lo:105: Request processed in 72us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216844.083337:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1782216844.083353:0:5780:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGC192.168.203.119@tcp lock: 0000000022aa1e52/0xf210a9075089e934 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089e93b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.083360:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: 0000000022aa1e52/0xf210a9075089e934 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089e93b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216844.083404:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a771305b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733922048:0@lo:501: 00000100:00100000:2.0:1782216844.083426:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216844.083443:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set 000000000c00ae79 going to sleep for 11 seconds 00000100:00100000:2.0:1782216844.083453:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733922048 00000100:00100000:2.0:1782216844.083456:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733922048 00000100:00100000:2.0:1782216844.083475:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782216844.083479:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b9c956bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+11:5780:x1868789733922048:12345-0@lo:501: 00000100:00100000:2.0:1782216844.083580:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b9c956bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+11:5780:x1868789733922048:12345-0@lo:501: Request processed in 101us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216844.083591:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782216844.083621:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a771305b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733922048:0@lo:501: 00000100:00100000:2.0:1782216844.083643:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a771305b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733922176:0@lo:503: 00000100:00100000:2.0:1782216844.083675:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216844.083685:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set 000000000c00ae79 going to sleep for 11 seconds 00000100:00100000:2.0:1782216844.083923:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733922176 00000100:00100000:2.0:1782216844.083927:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733922176 00000100:00100000:2.0:1782216844.083945:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782216844.083949:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000696c41c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+11:5780:x1868789733922176:12345-0@lo:503: 00000100:00100000:1.0:1782216844.084427:0:5770:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000f2b6250d pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:MGS:5770:1868789733921920:0@lo:105: 00000100:00100000:2.0:1782216844.084459:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000696c41c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+11:5780:x1868789733922176:12345-0@lo:503: Request processed in 508us (782us total) trans 0 rc 0/0 00010000:00010000:1.0:1782216844.084459:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000eccd78e7/0xf210a9075089e92d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216844.084473:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:1.0:1782216844.084478:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000eccd78e7/0xf210a9075089e92d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216844.084492:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782216844.084536:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004df8970a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:526a4802-b871-4bcf-870f-067f11655366+10:3303:x1868789733921664:12345-0@lo:103: Request processed in 1924us (2096us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216844.084544:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782216844.086175:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a771305b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733922176:0@lo:503: 00000100:00100000:2.0:1782216844.087346:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000009a853c64 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789733921664:0@lo:103: 00000100:00100000:1.0:1782216844.088263:0:6594:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000105f2a46 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:6594:1868789733922304:0@lo:502: 00000100:00100000:1.0:1782216844.088341:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216844.088396:0:6594:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f4e2e0ce going to sleep for 11 seconds 00000100:00100000:0.0:1782216844.088638:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733922304 00000100:00100000:0.0:1782216844.088645:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733922304 00000100:00100000:0.0:1782216844.088695:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782216844.088704:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb36ba1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+10:6594:x1868789733922304:12345-0@lo:502: 00000100:00100000:0.0:1782216844.091652:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb36ba1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+10:6594:x1868789733922304:12345-0@lo:502: Request processed in 2942us (3305us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216844.091667:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782216844.095102:0:6594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000105f2a46 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:6594:1868789733922304:0@lo:502: 00000100:00100000:1.0:1782216844.095182:0:6594:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000105f2a46 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:6594:1868789733922432:0@lo:502: 00000100:00100000:1.0:1782216844.095253:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216844.095291:0:6594:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f4e2e0ce going to sleep for 11 seconds 00000100:00100000:3.0:1782216844.098955:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733922432 00000100:00100000:3.0:1782216844.098970:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733922432 00000100:00100000:3.0:1782216844.099035:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782216844.099045:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f159a1d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+10:6594:x1868789733922432:12345-0@lo:502: 00000100:00100000:3.0:1782216844.099544:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f159a1d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+10:6594:x1868789733922432:12345-0@lo:502: Request processed in 499us (4289us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216844.099562:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782216844.100364:0:6594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000105f2a46 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:6594:1868789733922432:0@lo:502: 00000040:00080000:0.0:1782216844.100400:0:6594:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1782216844.105869:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1782216844.105919:0:5780:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782216844.105928:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: 0000000022aa1e52/0xf210a9075089e934 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e93b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.105941:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: 0000000022aa1e52/0xf210a9075089e934 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e93b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216844.105952:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1782216844.105954:0:5780:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1782216844.105957:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1782216844.105992:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: 000000003373cf85/0xf210a9075089e942 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.106010:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: 000000003373cf85/0xf210a9075089e942 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.106020:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: 000000003373cf85/0xf210a9075089e942 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216844.106042:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000f88691a5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733922560:0@lo:101: 00000100:00100000:2.0:1782216844.106109:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216844.106148:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b3ef9f66 going to sleep for 11 seconds 00000100:00100000:3.0:1782216844.106416:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733922560 00000100:00100000:3.0:1782216844.106423:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733922560 00000100:00100000:3.0:1782216844.106460:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782216844.106467:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2362f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+10:5780:x1868789733922560:12345-0@lo:101: 00010000:00010000:3.0:1782216844.106480:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782216844.106490:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e593ba5e/0xf210a9075089e949 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089e942 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216844.106523:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e593ba5e/0xf210a9075089e949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089e942 expref: 11 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216844.106531:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e593ba5e/0xf210a9075089e949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089e942 expref: 11 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216844.106540:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e593ba5e, rc 0) 00000100:00100000:3.0:1782216844.106589:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2362f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+11:5780:x1868789733922560:12345-0@lo:101: Request processed in 122us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216844.106595:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782216844.108513:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000f88691a5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733922560:0@lo:101: 00010000:00010000:2.0:1782216844.108538:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: 000000003373cf85/0xf210a9075089e942 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e949 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.108564:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: 000000003373cf85/0xf210a9075089e942 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089e949 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216844.110699:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000f88691a5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733922688:0@lo:501: 00000100:00100000:2.0:1782216844.110768:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216844.110803:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b3ef9f66 going to sleep for 11 seconds 00000100:00100000:3.0:1782216844.111792:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733922688 00000100:00100000:3.0:1782216844.111803:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733922688 00000100:00100000:3.0:1782216844.111853:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782216844.111862:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057805d6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+11:5780:x1868789733922688:12345-0@lo:501: 00000100:00100000:3.0:1782216844.112205:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057805d6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+11:5780:x1868789733922688:12345-0@lo:501: Request processed in 343us (1437us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216844.112213:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782216844.112339:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000f88691a5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733922688:0@lo:501: 00000100:00100000:0.0:1782216844.112413:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c5321677 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733922816:0@lo:503: 00000100:00100000:0.0:1782216844.112456:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216844.112497:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set 000000003f43dda7 going to sleep for 11 seconds 00000100:00100000:3.0:1782216844.112605:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733922816 00000100:00100000:3.0:1782216844.112612:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733922816 00000100:00100000:3.0:1782216844.112713:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782216844.112720:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045a98cab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+11:5780:x1868789733922816:12345-0@lo:503: 00000100:00100000:3.0:1782216844.112904:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045a98cab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+11:5780:x1868789733922816:12345-0@lo:503: Request processed in 185us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216844.112913:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782216844.113321:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c5321677 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733922816:0@lo:503: 00000100:00100000:3.0:1782216844.118016:0:6595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b7defee4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:6595:1868789733922944:0@lo:502: 00000100:00100000:3.0:1782216844.118231:0:6595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216844.118286:0:6595:0:(client.c:2701:ptlrpc_set_wait()) set 0000000065fd8587 going to sleep for 11 seconds 00000100:00100000:2.0:1782216844.118305:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733922944 00000100:00100000:2.0:1782216844.118312:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733922944 00000100:00100000:2.0:1782216844.118351:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1782216844.118359:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000188fe4e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+11:6595:x1868789733922944:12345-0@lo:502: 00000100:00100000:2.0:1782216844.118591:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000188fe4e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+11:6595:x1868789733922944:12345-0@lo:502: Request processed in 232us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216844.118599:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782216844.118675:0:6595:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b7defee4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:6595:1868789733922944:0@lo:502: 00000020:01000000:3.0:1782216844.118703:0:6595:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1782216844.118710:0:6595:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1782216844.118716:0:6595:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782216844.118718:0:6595:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1782216844.118723:0:6595:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1782216844.118727:0:6595:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.119@tcp to nid 0x20000c0a8cb77 (192.168.203.119@tcp) 00000020:01000000:3.0:1782216844.118747:0:6595:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1782216844.118750:0:6595:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782216844.118764:0:6595:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (00000000775129b4) 00000020:00000080:3.0:1782216844.118783:0:6595:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osp with refcount 2 00000020:00000080:3.0:1782216844.118788:0:6595:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1782216844.118863:0:6595:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1782216844.118868:0:6595:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:3.0:1782216844.118891:0:6595:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf210a9075089e957 00010000:00080000:3.0:1782216844.118921:0:6595:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000db8f62af@lustre-OST0000-osc-MDT0000: add connection 192.168.203.119@tcp at head 00010000:00010000:3.0:1782216844.119297:0:6595:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1782216844.190976:0:6595:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1782216844.190997:0:6595:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1782216844.191989:0:6595:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782216844.197417:0:6595:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782216844.197557:0:6595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1782216844.197702:0:6595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1782216844.198453:0:6596:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782216844.198459:0:6596:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1782216844.199317:0:6595:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782216844.199329:0:6595:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1782216844.199361:0:6595:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1782216844.199379:0:6595:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf210a9075089e95e 00000100:00080000:2.0:1782216844.199390:0:6595:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782216844.199395:0:6595:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import 00000000db8f62af using connection 192.168.203.119@tcp/0@lo 00000100:00100000:2.0:1782216844.199428:0:6595:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000078644c95 x1868789733923072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782216844.199456:0:6595:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1782216844.199577:0:3300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000078644c95 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1868789733923072:0@lo:8: 00000100:00100000:0.0:1782216844.199651:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1782216844.199839:0:6595:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782216844.199843:0:6595:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782216844.199844:0:6595:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1782216844.199847:0:6595:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782216844.199851:0:6595:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782216844.199852:0:6595:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:2.0:1782216844.199855:0:6595:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1782216844.199856:0:6595:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1782216844.199900:0:6595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c3948f8a pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:6595:1868789733923200:0@lo:502: 00000100:00100000:2.0:1782216844.199943:0:6595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216844.199958:0:6595:0:(client.c:2701:ptlrpc_set_wait()) set 00000000836df975 going to sleep for 11 seconds 00000100:00100000:3.0:1782216844.200261:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733923200 00000100:00100000:3.0:1782216844.200268:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733923200 00000100:00100000:3.0:1782216844.200314:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782216844.200322:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022542a3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+11:6595:x1868789733923200:12345-0@lo:502: 00000100:00100000:3.0:1782216844.200767:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022542a3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+11:6595:x1868789733923200:12345-0@lo:502: Request processed in 445us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216844.200776:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1782216844.200956:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733923072 00000100:00100000:2.0:1782216844.200961:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733923072 00000100:00100000:2.0:1782216844.200982:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782216844.200987:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5321677 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3300:x1868789733923072:12345-0@lo:8: 00010000:00020000:2.0:1782216844.201001:0:6578:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1782216844.201039:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5321677 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3300:x1868789733923072:12345-0@lo:8: Request processed in 51us (1389us total) trans 0 rc -19/-19 00000100:00100000:2.0:1782216844.201057:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782216844.201073:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782216844.201090:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000609ef05c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789733923328:0@lo:400: 00000100:00100000:2.0:1782216844.201175:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216844.201215:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733923328 00000100:00100000:2.0:1782216844.201218:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733923328 00000100:00100000:2.0:1782216844.201244:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782216844.201249:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a98e890b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789733923328:12345-0@lo:400: 00000100:00100000:2.0:1782216844.201285:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a98e890b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789733923328:12345-0@lo:400: Request processed in 36us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216844.201291:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1782216844.201322:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000609ef05c x1868789733923328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216844.201335:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000609ef05c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789733923328:0@lo:400: 00000100:00080000:3.0:1782216844.203305:0:3300:0:(import.c:65:import_set_state_nolock()) 00000000db8f62af lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782216844.203316:0:3300:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1782216844.203320:0:3300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000078644c95 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1868789733923072:0@lo:8: 00000100:00100000:0.0:1782216844.206918:0:6595:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c3948f8a pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:6595:1868789733923200:0@lo:502: 00000020:01000000:0.0:1782216844.206982:0:6595:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782216844.206990:0:6595:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782216844.206992:0:6595:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:0.0:1782216844.206997:0:6595:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1782216844.208785:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1782216844.208815:0:5780:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1782216844.208824:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: 000000003373cf85/0xf210a9075089e942 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e949 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.208835:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: 000000003373cf85/0xf210a9075089e942 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e949 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216844.208844:0:5780:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782216844.208846:0:5780:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff88e650a2a800 from 1 10000000:01000000:2.0:1782216844.208849:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782216844.208918:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: 0000000088aff093/0xf210a9075089e965 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.208926:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: 0000000088aff093/0xf210a9075089e965 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.208951:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: 0000000088aff093/0xf210a9075089e965 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216844.208971:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000609ef05c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733923456:0@lo:101: 00000100:00100000:2.0:1782216844.209034:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216844.209217:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733923456 00000100:00100000:1.0:1782216844.209224:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733923456 00000100:00100000:1.0:1782216844.209267:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782216844.209276:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de36d4e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+11:5780:x1868789733923456:12345-0@lo:101: 00010000:00010000:1.0:1782216844.209289:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782216844.209301:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005430a9a7/0xf210a9075089e96c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089e965 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216844.209321:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005430a9a7/0xf210a9075089e96c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089e965 expref: 12 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216844.209329:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005430a9a7/0xf210a9075089e96c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089e965 expref: 12 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216844.209336:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005430a9a7, rc 0) 00000100:00100000:1.0:1782216844.213897:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de36d4e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+12:5780:x1868789733923456:12345-0@lo:101: Request processed in 4596us (4837us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216844.213911:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1782216844.216423:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set 00000000836df975 going to sleep for 11 seconds 00000100:00100000:2.0:1782216844.216463:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000609ef05c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733923456:0@lo:101: 00010000:00010000:2.0:1782216844.216486:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: 0000000088aff093/0xf210a9075089e965 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e96c expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.216498:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: 0000000088aff093/0xf210a9075089e965 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089e96c expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216844.216574:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000609ef05c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733923584:0@lo:501: 00000100:00100000:2.0:1782216844.216627:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216844.216647:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set 00000000836df975 going to sleep for 11 seconds 00000100:00100000:2.0:1782216844.216666:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733923584 00000100:00100000:2.0:1782216844.216671:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733923584 00000100:00100000:2.0:1782216844.216710:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782216844.216717:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2fa4c62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+12:5780:x1868789733923584:12345-0@lo:501: 00000100:00100000:2.0:1782216844.216955:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2fa4c62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+12:5780:x1868789733923584:12345-0@lo:501: Request processed in 237us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216844.216962:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782216844.216997:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000609ef05c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733923584:0@lo:501: 00000100:00100000:2.0:1782216844.217021:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000609ef05c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733923712:0@lo:503: 00000100:00100000:2.0:1782216844.217076:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216844.217095:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set 00000000836df975 going to sleep for 11 seconds 00000100:00100000:2.0:1782216844.217106:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733923712 00000100:00100000:2.0:1782216844.217109:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733923712 00000100:00100000:2.0:1782216844.217239:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782216844.217246:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005528c6b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+12:5780:x1868789733923712:12345-0@lo:503: 00000100:00100000:2.0:1782216844.217425:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005528c6b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+12:5780:x1868789733923712:12345-0@lo:503: Request processed in 180us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216844.217432:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782216844.217468:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000609ef05c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733923712:0@lo:503: 00000100:00100000:1.0:1782216844.217777:0:6598:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002d6ac992 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:6598:1868789733923840:0@lo:502: 00000100:00100000:1.0:1782216844.217814:0:6598:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216844.217835:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733923840 00000100:00100000:1.0:1782216844.217838:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733923840 00000100:00100000:1.0:1782216844.217858:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782216844.217870:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a83596e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+12:6598:x1868789733923840:12345-0@lo:502: 00000100:00100000:1.0:1782216844.218029:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a83596e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+12:6598:x1868789733923840:12345-0@lo:502: Request processed in 159us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216844.218036:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782216844.218086:0:6598:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ee37d727 going to sleep for 11 seconds 00000100:00100000:1.0:1782216844.218099:0:6598:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002d6ac992 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:6598:1868789733923840:0@lo:502: 00000020:01000000:1.0:1782216844.218233:0:6598:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782216844.218242:0:6598:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216844.218245:0:6598:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1782216844.218252:0:6598:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff88e650a2a800 00000020:00000080:1.0:1782216844.218254:0:6598:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1782216844.218288:0:6598:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b94380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:6598:1868789733923968:0@lo:502: 00000100:00100000:1.0:1782216844.218320:0:6598:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216844.218338:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733923968 00000100:00100000:1.0:1782216844.218342:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733923968 00000100:00100000:1.0:1782216844.218361:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782216844.218367:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+12:6598:x1868789733923968:12345-0@lo:502: 00000100:00100000:1.0:1782216844.218465:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+12:6598:x1868789733923968:12345-0@lo:502: Request processed in 98us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216844.218471:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782216844.218500:0:6598:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e650716600 going to sleep for 11 seconds 00000100:00100000:1.0:1782216844.218511:0:6598:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b94380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:6598:1868789733923968:0@lo:502: 00000020:01000000:1.0:1782216844.218527:0:6598:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782216844.218531:0:6598:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216844.218533:0:6598:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1782216844.218536:0:6598:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1782216844.218589:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1782216844.218612:0:5780:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782216844.218620:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e682171e00/0xf210a9075089e965 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e96c expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216844.218629:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e682171e00/0xf210a9075089e965 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e96c expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782216844.218636:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1782216844.218639:0:5780:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff88e6484dcd40 from 1 10000000:01000000:1.0:1782216844.218641:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1782216844.218662:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e641492800/0xf210a9075089e973 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216844.218669:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e641492800/0xf210a9075089e973 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216844.218676:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e641492800/0xf210a9075089e973 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216844.218687:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b94380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733924096:0@lo:101: 00000100:00100000:1.0:1782216844.218712:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216844.218724:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e650716600 going to sleep for 11 seconds 00000100:00100000:1.0:1782216844.218735:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733924096 00000100:00100000:1.0:1782216844.218737:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733924096 00000100:00100000:1.0:1782216844.218755:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782216844.218760:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+12:5780:x1868789733924096:12345-0@lo:101: 00010000:00010000:1.0:1782216844.218767:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782216844.218777:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e641493a00/0xf210a9075089e97a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089e973 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216844.218805:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e641493a00/0xf210a9075089e97a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089e973 expref: 13 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216844.218814:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e641493a00/0xf210a9075089e97a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089e973 expref: 13 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216844.218822:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e641493a00, rc 0) 00000100:00100000:1.0:1782216844.218850:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+13:5780:x1868789733924096:12345-0@lo:101: Request processed in 89us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216844.218857:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782216844.218919:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b94380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733924096:0@lo:101: 00010000:00010000:1.0:1782216844.218930:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e641492800/0xf210a9075089e973 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e97a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216844.218938:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e641492800/0xf210a9075089e973 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089e97a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216844.218972:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b94380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733924224:0@lo:501: 00000100:00100000:1.0:1782216844.218996:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216844.219014:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e650716600 going to sleep for 11 seconds 00000100:00100000:1.0:1782216844.219023:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733924224 00000100:00100000:1.0:1782216844.219026:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733924224 00000100:00100000:1.0:1782216844.220459:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1782216844.220474:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+13:5780:x1868789733924224:12345-0@lo:501: 00000100:00100000:1.0:1782216844.220718:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+13:5780:x1868789733924224:12345-0@lo:501: Request processed in 248us (1720us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782216844.220726:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1782216844.220998:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b94380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733924224:0@lo:501: 10000000:01000000:3.0:1782216844.221031:0:5780:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1782216844.221040:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e641492800/0xf210a9075089e973 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e97a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216844.221061:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e641492800/0xf210a9075089e973 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e97a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216844.231332:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+12:6575:x1868789733920896:12345-0@lo:253: Request processed in 158451us (158813us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216844.231346:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782216844.231461:0:6575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:6575:1868789733920896:0@lo:253: 10000000:01000000:0.0:1782216844.231475:0:6575:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1782216844.231479:0:6575:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782216844.231480:0:6575:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782216844.231481:0:6575:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782216844.231482:0:6575:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1782216844.231483:0:6575:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782216844.231484:0:6575:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782216844.231486:0:6575:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782216844.231487:0:6575:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1782216844.231489:0:6575:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782216844.231490:0:6575:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1782216844.231510:0:6575:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88e673f4d000 from lustre-OST0000 10000000:01000000:0.0:1782216844.231535:0:6575:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1782216844.231537:0:6575:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1782216844.231566:0:6575:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff88e6484dcd40 local copy 00010000:00010000:0.0:1782216844.231578:0:6575:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e641492800/0xf210a9075089e973 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e97a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216844.231680:0:6575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:6575:1868789733924352:0@lo:501: 00000100:00100000:0.0:1782216844.231715:0:6575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216844.231829:0:6575:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e67f2e5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782216844.232000:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733924352 00000100:00100000:1.0:1782216844.232007:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733924352 00000100:00100000:1.0:1782216844.232042:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1782216844.232228:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+12:6575:x1868789733924352:12345-0@lo:501: 00000100:00100000:1.0:1782216844.232434:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+12:6575:x1868789733924352:12345-0@lo:501: Request processed in 209us (717us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782216844.232477:0:6575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:6575:1868789733924352:0@lo:501: 10000000:01000000:0.0:1782216844.232491:0:6575:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.119@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1782216844.232516:0:6575:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.119@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1782216844.232522:0:6575:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e641492800/0xf210a9075089e973 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e97a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216844.232530:0:6575:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e641492800/0xf210a9075089e973 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e97a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216844.232561:0:6575:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88e673f4d000 10000000:01000000:0.0:1782216844.232566:0:6575:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1782216844.232570:0:6575:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff88e6484dcd40 10000000:01000000:0.0:1782216844.232572:0:6575:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1782216844.232575:0:6575:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff88e6484dcd40 from 1 10000000:01000000:0.0:1782216844.232578:0:6575:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782216844.232601:0:6575:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e640030c00/0xf210a9075089e981 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216844.232610:0:6575:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e640030c00/0xf210a9075089e981 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216844.232618:0:6575:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e640030c00/0xf210a9075089e981 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216844.232640:0:6575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:6575:1868789733924480:0@lo:101: 00000100:00100000:0.0:1782216844.232672:0:6575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216844.232716:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733924480 00000100:00100000:2.0:1782216844.232721:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733924480 00000100:00100000:2.0:1782216844.232741:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782216844.232748:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+13:6575:x1868789733924480:12345-0@lo:101: 00010000:00010000:2.0:1782216844.232756:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216844.232769:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e682170800/0xf210a9075089e988 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089e981 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.232788:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e682170800/0xf210a9075089e988 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089e981 expref: 14 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.232797:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e682170800/0xf210a9075089e988 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089e981 expref: 14 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.232805:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e682170800, rc 0) 00000100:00100000:2.0:1782216844.232831:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+14:6575:x1868789733924480:12345-0@lo:101: Request processed in 84us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216844.232847:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1782216844.233186:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1782216844.233275:0:6575:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e67f2e5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782216844.233291:0:6575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:6575:1868789733924480:0@lo:101: 00010000:00010000:0.0:1782216844.233303:0:6575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e640030c00/0xf210a9075089e981 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e988 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216844.233311:0:6575:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e640030c00/0xf210a9075089e981 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089e988 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216844.233326:0:6575:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782216844.233381:0:6575:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e640030c00/0xf210a9075089e981 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e988 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216844.233388:0:6575:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e640030c00/0xf210a9075089e981 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e988 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216844.233395:0:6575:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1782216844.233399:0:6575:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1782216844.233402:0:6575:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1782216844.233404:0:6575:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1782216844.233420:0:6575:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e640030a00/0xf210a9075089e98f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216844.233425:0:6575:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e640030a00/0xf210a9075089e98f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216844.233432:0:6575:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e640030a00/0xf210a9075089e98f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216844.233451:0:6575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:6575:1868789733924608:0@lo:101: 00000100:00100000:0.0:1782216844.233477:0:6575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216844.233502:0:6575:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e67f2e5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782216844.233558:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733924608 00000100:00100000:2.0:1782216844.233564:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733924608 00000100:00100000:2.0:1782216844.233598:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782216844.233605:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+13:6575:x1868789733924608:12345-0@lo:101: 00010000:00010000:2.0:1782216844.233613:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216844.233621:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e682171400/0xf210a9075089e996 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089e98f expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.233636:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e682171400/0xf210a9075089e996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089e98f expref: 14 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.233644:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e682171400/0xf210a9075089e996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089e98f expref: 14 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.233651:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e682171400, rc 0) 00000100:00100000:2.0:1782216844.233753:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+14:6575:x1868789733924608:12345-0@lo:101: Request processed in 148us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216844.233760:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1782216844.233950:0:6575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:6575:1868789733924608:0@lo:101: 00010000:00010000:1.0:1782216844.233962:0:6575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e640030a00/0xf210a9075089e98f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e996 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216844.233970:0:6575:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e640030a00/0xf210a9075089e98f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089e996 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216844.234112:0:6575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b96a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:6575:1868789733924736:0@lo:501: 00000100:00100000:1.0:1782216844.234209:0:6575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216844.234272:0:6575:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e65081f240 going to sleep for 11 seconds 00000100:00100000:2.0:1782216844.234302:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733924736 00000100:00100000:2.0:1782216844.234306:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733924736 00000100:00100000:2.0:1782216844.234362:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1782216844.234370:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+14:6575:x1868789733924736:12345-0@lo:501: 00000100:00100000:2.0:1782216844.234585:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+14:6575:x1868789733924736:12345-0@lo:501: Request processed in 215us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216844.234591:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1782216844.234646:0:6575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b96a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:6575:1868789733924736:0@lo:501: 00000100:00100000:1.0:1782216844.234673:0:6575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b96a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:6575:1868789733924864:0@lo:503: 00000100:00100000:1.0:1782216844.234711:0:6575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216844.234777:0:6575:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e65081f240 going to sleep for 11 seconds 00000100:00100000:0.0:1782216844.234920:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733924864 00000100:00100000:0.0:1782216844.234925:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733924864 00000100:00100000:0.0:1782216844.234946:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1782216844.234952:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+14:6575:x1868789733924864:12345-0@lo:503: 00000100:00100000:0.0:1782216844.235325:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+14:6575:x1868789733924864:12345-0@lo:503: Request processed in 370us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216844.235333:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1782216844.235403:0:6575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b96a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:6575:1868789733924864:0@lo:503: 00000040:00080000:1.0:1782216844.235703:0:6575:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782216844.235765:0:6575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b96a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:6575:1868789733924992:0@lo:502: 00000100:00100000:1.0:1782216844.235802:0:6575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216844.235845:0:6575:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e680592b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782216844.236035:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733924992 00000100:00100000:2.0:1782216844.236041:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733924992 00000100:00100000:2.0:1782216844.236279:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1782216844.236290:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+14:6575:x1868789733924992:12345-0@lo:502: 00000100:00100000:2.0:1782216844.236465:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+14:6575:x1868789733924992:12345-0@lo:502: Request processed in 176us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216844.236473:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1782216844.236541:0:6575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b96a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:6575:1868789733924992:0@lo:502: 00000040:00080000:1.0:1782216844.236761:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1782216844.236810:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1782216844.236854:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1782216844.236937:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1782216844.236976:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1782216844.237009:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1782216844.237035:0:6575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b96a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:6575:1868789733925120:0@lo:502: 00000100:00100000:1.0:1782216844.237204:0:6575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216844.237504:0:6575:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e680592b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782216844.237541:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733925120 00000100:00100000:0.0:1782216844.237569:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733925120 00000100:00100000:0.0:1782216844.237596:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1782216844.237602:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+14:6575:x1868789733925120:12345-0@lo:502: 00000100:00100000:0.0:1782216844.237793:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+14:6575:x1868789733925120:12345-0@lo:502: Request processed in 189us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216844.237801:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1782216844.238391:0:6575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b96a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:6575:1868789733925120:0@lo:502: 00000040:00080000:1.0:1782216844.238517:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1782216844.238530:0:6575:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1782216844.239424:0:6599:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1782216844.239433:0:6599:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1782216844.239440:0:6599:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782216844.239442:0:6599:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1782216844.239449:0:6599:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782216844.239463:0:6599:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff88e675583380) 00000020:00000080:3.0:1782216844.239482:0:6599:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type obdfilter with refcount 2 00000020:00000080:3.0:1782216844.239489:0:6599:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1782216844.239556:0:6599:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88e673f4d000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1782216844.239567:0:6599:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1782216844.239574:0:6599:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf210a9075089e9a4 00010000:00010000:3.0:1782216844.246495:0:6599:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1782216844.246786:0:6599:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1782216844.250082:0:6599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1782216844.250510:0:6599:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1782216844.260799:0:6599:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1782216844.261436:0:6599:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1782216844.263301:0:6599:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1782216844.263313:0:6599:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782216844.263319:0:6599:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782216844.263321:0:6599:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1782216844.263325:0:6599:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782216844.263329:0:6599:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782216844.263330:0:6599:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782216844.263333:0:6599:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782216844.263335:0:6599:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1782216844.263387:0:6599:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782216844.263395:0:6599:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782216844.263396:0:6599:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1782216844.263399:0:6599:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1782216844.265863:0:6575:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1782216844.265918:0:6575:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1782216844.265939:0:6575:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e640030a00/0xf210a9075089e98f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e996 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216844.265952:0:6575:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e640030a00/0xf210a9075089e98f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e996 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216844.265961:0:6575:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff88e673f4d000 from 1 10000000:01000000:0.0:1782216844.265963:0:6575:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782216844.266003:0:6575:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e640031600/0xf210a9075089e9ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216844.266011:0:6575:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e640031600/0xf210a9075089e9ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216844.266022:0:6575:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e640031600/0xf210a9075089e9ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216844.266055:0:6575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:6575:1868789733925248:0@lo:101: 00000100:00100000:0.0:1782216844.266255:0:6575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216844.266303:0:6575:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e67f2e53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782216844.266331:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733925248 00000100:00100000:0.0:1782216844.266337:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733925248 00000100:00100000:0.0:1782216844.266385:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1782216844.266394:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+14:6575:x1868789733925248:12345-0@lo:101: 00010000:00010000:0.0:1782216844.266406:0:5775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216844.266426:0:5775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e640031200/0xf210a9075089e9b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089e9ab expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216844.266450:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e640031200/0xf210a9075089e9b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089e9ab expref: 15 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216844.266459:0:5775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e640031200/0xf210a9075089e9b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089e9ab expref: 15 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216844.266468:0:5775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e640031200, rc 0) 00000100:00100000:0.0:1782216844.266506:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+15:6575:x1868789733925248:12345-0@lo:101: Request processed in 113us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216844.266513:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1782216844.266585:0:6575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:6575:1868789733925248:0@lo:101: 00010000:00010000:0.0:1782216844.266599:0:6575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e640031600/0xf210a9075089e9ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e9b2 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216844.266607:0:6575:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e640031600/0xf210a9075089e9ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089e9b2 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216844.266695:0:6575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:6575:1868789733925376:0@lo:501: 00000100:00100000:0.0:1782216844.266720:0:6575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216844.266734:0:6575:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e67f2e53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782216844.266976:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733925376 00000100:00100000:0.0:1782216844.266980:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733925376 00000100:00100000:0.0:1782216844.267052:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1782216844.267060:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+15:6575:x1868789733925376:12345-0@lo:501: 00000100:00100000:0.0:1782216844.268612:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+15:6575:x1868789733925376:12345-0@lo:501: Request processed in 1546us (1885us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216844.268633:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1782216844.271557:0:6575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:6575:1868789733925376:0@lo:501: 00000100:00100000:0.0:1782216844.271616:0:6575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:6575:1868789733925504:0@lo:503: 00000100:00100000:0.0:1782216844.271683:0:6575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216844.273134:0:6575:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e67f2e53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782216844.273297:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733925504 00000100:00100000:2.0:1782216844.273305:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733925504 00000100:00100000:2.0:1782216844.273349:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782216844.273357:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+15:6575:x1868789733925504:12345-0@lo:503: 00000100:00100000:2.0:1782216844.273540:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+15:6575:x1868789733925504:12345-0@lo:503: Request processed in 183us (1856us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216844.273560:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782216844.273612:0:6575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:6575:1868789733925504:0@lo:503: 00000040:00080000:2.0:1782216844.273849:0:6575:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782216844.273934:0:6575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652480380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:6575:1868789733925632:0@lo:502: 00000100:00100000:2.0:1782216844.273971:0:6575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216844.273986:0:6575:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e650a4d600 going to sleep for 11 seconds 00000100:00100000:2.0:1782216844.273998:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733925632 00000100:00100000:2.0:1782216844.274002:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733925632 00000100:00100000:2.0:1782216844.274019:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1782216844.274025:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+15:6575:x1868789733925632:12345-0@lo:502: 00000100:00100000:2.0:1782216844.274224:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+15:6575:x1868789733925632:12345-0@lo:502: Request processed in 198us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216844.274232:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1782216844.274272:0:6575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652480380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:6575:1868789733925632:0@lo:502: 00000040:00080000:2.0:1782216844.274511:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1782216844.274568:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1782216844.274590:0:6575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652480380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:6575:1868789733925760:0@lo:502: 00000100:00100000:2.0:1782216844.274629:0:6575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216844.274644:0:6575:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e650a4d600 going to sleep for 11 seconds 00000100:00100000:2.0:1782216844.274658:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733925760 00000100:00100000:2.0:1782216844.274662:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733925760 00000100:00100000:2.0:1782216844.274680:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1782216844.274685:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+15:6575:x1868789733925760:12345-0@lo:502: 00000100:00100000:2.0:1782216844.274799:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+15:6575:x1868789733925760:12345-0@lo:502: Request processed in 112us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216844.274805:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1782216844.274843:0:6575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652480380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:6575:1868789733925760:0@lo:502: 00000040:00080000:2.0:1782216844.274937:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1782216844.274945:0:6575:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1782216844.276707:0:6604:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782216844.276718:0:6604:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782216844.276721:0:6604:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1782216844.276728:0:6604:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff88e673f4d000 00000020:00000080:0.0:1782216844.276731:0:6604:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782216844.276751:0:6604:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782216844.276754:0:6604:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782216844.276755:0:6604:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1782216844.276758:0:6604:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1782216844.277270:0:6575:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1782216844.277293:0:6575:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782216844.277343:0:6575:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e640031600/0xf210a9075089e9ab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e9b2 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.277355:0:6575:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e640031600/0xf210a9075089e9ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e9b2 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216844.277394:0:6575:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1782216844.277397:0:6575:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88e673f4d000 10000000:01000000:2.0:1782216844.277401:0:6575:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88e673f4d000 10000000:01000000:2.0:1782216844.277405:0:6575:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782216844.277410:0:6575:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff88e673f4d000 from 1 10000000:01000000:2.0:1782216844.277412:0:6575:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782216844.277443:0:6575:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e682171600/0xf210a9075089e9b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.277467:0:6575:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e682171600/0xf210a9075089e9b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.277478:0:6575:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e682171600/0xf210a9075089e9b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216844.277497:0:6575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652480380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:6575:1868789733925888:0@lo:101: 00000100:00100000:2.0:1782216844.277572:0:6575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216844.277617:0:6575:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e650a4d780 going to sleep for 11 seconds 00000100:00100000:3.0:1782216844.277686:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733925888 00000100:00100000:3.0:1782216844.277693:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733925888 00000100:00100000:3.0:1782216844.277740:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1782216844.277749:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+15:6575:x1868789733925888:12345-0@lo:101: 00010000:00010000:3.0:1782216844.277762:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782216844.277774:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e653161e00/0xf210a9075089e9c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089e9b9 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216844.277796:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e653161e00/0xf210a9075089e9c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089e9b9 expref: 16 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216844.277806:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e653161e00/0xf210a9075089e9c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089e9b9 expref: 16 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216844.277814:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e653161e00, rc 0) 00000100:00100000:3.0:1782216844.278056:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+16:6575:x1868789733925888:12345-0@lo:101: Request processed in 297us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216844.278064:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1782216844.278274:0:6575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652480380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:6575:1868789733925888:0@lo:101: 00010000:00010000:2.0:1782216844.278289:0:6575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e682171600/0xf210a9075089e9b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e9c0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216844.278298:0:6575:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e682171600/0xf210a9075089e9b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089e9c0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216844.278391:0:6575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652480380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:6575:1868789733926016:0@lo:501: 00000100:00100000:2.0:1782216844.278420:0:6575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216844.278484:0:6575:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e650a4d780 going to sleep for 11 seconds 00000100:00100000:1.0:1782216844.278538:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733926016 00000100:00100000:1.0:1782216844.278542:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733926016 00000100:00100000:1.0:1782216844.278614:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1782216844.278622:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+16:6575:x1868789733926016:12345-0@lo:501: 00000100:00100000:1.0:1782216844.278865:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+16:6575:x1868789733926016:12345-0@lo:501: Request processed in 243us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216844.278872:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782216844.278978:0:6575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652480380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:6575:1868789733926016:0@lo:501: 00000100:00100000:2.0:1782216844.279005:0:6575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652480380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:6575:1868789733926144:0@lo:503: 00000100:00100000:2.0:1782216844.279053:0:6575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216844.279482:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733926144 00000100:00100000:0.0:1782216844.279487:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733926144 00000100:00100000:0.0:1782216844.279514:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1782216844.279521:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e65774ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+16:6575:x1868789733926144:12345-0@lo:503: 00000100:00100000:0.0:1782216844.279673:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e65774ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+16:6575:x1868789733926144:12345-0@lo:503: Request processed in 153us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216844.279679:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1782216844.279791:0:6575:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e650a4d780 going to sleep for 11 seconds 00000100:00100000:3.0:1782216844.279806:0:6575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652480380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:6575:1868789733926144:0@lo:503: 00000040:00080000:3.0:1782216844.280368:0:6575:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782216844.280440:0:6575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:6575:1868789733926272:0@lo:502: 00000100:00100000:3.0:1782216844.280490:0:6575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216844.280565:0:6575:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6738e7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782216844.280601:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733926272 00000100:00100000:0.0:1782216844.280606:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733926272 00000100:00100000:0.0:1782216844.280668:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1782216844.280678:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e65774d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+16:6575:x1868789733926272:12345-0@lo:502: 00000100:00100000:0.0:1782216844.280860:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e65774d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+16:6575:x1868789733926272:12345-0@lo:502: Request processed in 183us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216844.280916:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1782216844.281081:0:6575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:6575:1868789733926272:0@lo:502: 00000040:00080000:3.0:1782216844.281347:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1782216844.281392:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1782216844.281422:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1782216844.281461:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1782216844.281493:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1782216844.281540:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1782216844.281589:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1782216844.281621:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1782216844.281668:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1782216844.281704:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1782216844.281738:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1782216844.281794:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1782216844.281841:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1782216844.281916:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1782216844.282016:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1782216844.282058:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1782216844.282093:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1782216844.282140:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1782216844.282175:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1782216844.282209:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1782216844.282267:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1782216844.282304:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1782216844.282336:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1782216844.282381:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1782216844.282417:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1782216844.282449:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1782216844.282495:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1782216844.282531:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1782216844.282588:0:6575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:6575:1868789733926400:0@lo:502: 00000100:00100000:3.0:1782216844.282646:0:6575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216844.283609:0:6575:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6738e7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1782216844.283690:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733926400 00000100:00100000:1.0:1782216844.283698:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733926400 00000100:00100000:1.0:1782216844.283740:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1782216844.283749:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e65774f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+16:6575:x1868789733926400:12345-0@lo:502: 00000100:00100000:1.0:1782216844.284093:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e65774f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+16:6575:x1868789733926400:12345-0@lo:502: Request processed in 344us (1446us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216844.284101:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1782216844.284284:0:6575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:6575:1868789733926400:0@lo:502: 00000040:00080000:3.0:1782216844.284373:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1782216844.284387:0:6575:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1782216844.285413:0:6605:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1782216844.285430:0:6605:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff88e6577ecd40) 00000020:00000080:0.0:1782216844.285450:0:6605:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lwp with refcount 2 00000020:01000004:0.0:1782216844.285649:0:6605:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88e673f4d000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1782216844.285653:0:6605:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88e673f4d000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1782216844.285656:0:6605:0:(obd_mount.c:701:lustre_put_lsi()) put ffff88e673f4d000 3 00010000:00080000:0.0:1782216844.285683:0:6605:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88e6755cb000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.119@tcp at head 00010000:00010000:0.0:1782216844.288784:0:6605:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-3 is initialized 00000020:00000080:0.0:1782216844.290206:0:6605:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1782216844.290262:0:6605:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1782216844.290276:0:6605:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf210a9075089e9ce 00000100:00080000:0.0:1782216844.290286:0:6605:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782216844.290292:0:6605:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff88e6755cb000 using connection 192.168.203.119@tcp/0@lo 00000100:00100000:0.0:1782216844.290327:0:6605:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88e67a1e4a80 x1868789733926528/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782216844.293702:0:3300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3300:1868789733926528:0@lo:38: 00000100:00100000:3.0:1782216844.293779:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216844.293934:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733926528 00000100:00100000:2.0:1782216844.293942:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733926528 00000100:00100000:2.0:1782216844.293976:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782216844.293983:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3300:x1868789733926528:12345-0@lo:38: 00010000:00080000:2.0:1782216844.294021:0:5785:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 163 last 0 00000020:00000080:2.0:1782216844.294066:0:5785:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf210a9075089e9d5 00000004:00100000:2.0:1782216844.294080:0:5785:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1782216844.294112:0:5785:0:(import.c:65:import_set_state_nolock()) ffff88e643535800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782216844.294178:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1868789733926528:12345-0@lo:38: Request processed in 194us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216844.294185:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1782216844.294238:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88e67a1e4a80 x1868789733926528/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782216854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216844.294248:0:3300:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782216844.294255:0:3300:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1782216844.294261:0:3300:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1782216844.294266:0:3300:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1782216844.294269:0:3300:0:(import.c:65:import_set_state_nolock()) ffff88e6755cb000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1782216844.294275:0:3300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3300:1868789733926528:0@lo:38: 00000100:00080000:1.0:1782216844.294916:0:6605:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000040:00080000:2.0:1782216844.297712:0:6605:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1782216844.298678:0:6575:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1782216844.298707:0:6575:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782216844.298763:0:6575:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e682171600/0xf210a9075089e9b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e9c0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216844.298775:0:6575:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e682171600/0xf210a9075089e9b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e9c0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1782216844.298826:0:6575:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1782216844.298828:0:6575:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782216844.298829:0:6575:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782216844.298830:0:6575:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782216844.298842:0:6575:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782216844.298848:0:6575:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782216844.298849:0:6575:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782216844.298850:0:6575:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782216844.298852:0:6575:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782216844.298853:0:6575:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782216844.298854:0:6575:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1782216844.298858:0:6575:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1782216844.298860:0:6575:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782216844.298861:0:6575:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782216844.298862:0:6575:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782216844.298862:0:6575:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782216844.298863:0:6575:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782216844.298864:0:6575:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782216844.298865:0:6575:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782216844.298866:0:6575:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782216844.298867:0:6575:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782216844.298868:0:6575:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782216844.298868:0:6575:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1782216844.298921:0:6575:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1782216844.298940:0:6575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:6575:1868789733926656:0@lo:253: 00000100:00100000:0.0:1782216844.299007:0:6575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216844.299320:0:6575:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e67f2e5480 going to sleep for 11 seconds 00000100:00100000:1.0:1782216844.299436:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733926656 00000100:00100000:1.0:1782216844.299444:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733926656 00000100:00100000:1.0:1782216844.299481:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1782216844.299490:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e65774d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+16:6575:x1868789733926656:12345-0@lo:253: 20000000:01000000:1.0:1782216844.299515:0:5775:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1782216844.299527:0:5775:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1782216844.334786:0:5775:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1782216844.334805:0:5775:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1782216844.334995:0:5799:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1782216844.335001:0:5799:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1782216844.335025:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88e641493000/0xf210a9075089e9dc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216844.335053:0:5799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88e682171000/0xf210a9075089e90a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089e903 expref: 16 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216844.335062:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88e641493000/0xf210a9075089e9dc lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216844.335100:0:5799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88e682171000/0xf210a9075089e90a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf210a9075089e903 expref: 16 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216844.335114:0:5799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88e682171000/0xf210a9075089e90a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf210a9075089e903 expref: 16 pid: 5776 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216844.335140:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b96a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5799:1868789733926784:0@lo:104: 00000100:00100000:1.0:1782216844.335208:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216844.335272:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e646214e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782216844.335415:0:5767:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1782216844.335431:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733926784 00000100:00100000:3.0:1782216844.335438:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733926784 00000100:00100000:3.0:1782216844.335484:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782216844.335493:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64475e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:526a4802-b871-4bcf-870f-067f11655366+3:5799:x1868789733926784:12345-0@lo:104: 00010000:00010000:3.0:1782216844.335506:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.119@tcp lock: ffff88e640030200/0xf210a9075089e903 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089e90a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216844.335578:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782216844.335584:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64475e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:526a4802-b871-4bcf-870f-067f11655366+3:5799:x1868789733926784:12345-0@lo:104: Request processed in 92us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216844.335591:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1782216844.335631:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782216844.335637:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e640030200/0xf210a9075089e903 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089e90a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216844.335645:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640030200 already unused, calling callback (ffffffffc1d2fc20) 10000000:00010000:3.0:1782216844.335649:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e640030200/0xf210a9075089e903 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf210a9075089e90a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216844.335675:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e640030200/0xf210a9075089e903 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf210a9075089e90a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782216844.335682:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e640030200/0xf210a9075089e903 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf210a9075089e90a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782216844.335688:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1782216844.335715:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: ffff88e640030200/0xf210a9075089e903 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e90a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216844.335722:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782216844.335738:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e640030200/0xf210a9075089e903 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e90a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216844.335745:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e640030200/0xf210a9075089e903 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e90a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216844.335763:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216844.335765:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216844.335766:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216844.335786:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789733926912:0@lo:103: 00000100:00100000:3.0:1782216844.335816:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216844.335860:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733926912 00000100:00100000:3.0:1782216844.335865:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733926912 00010000:00010000:3.0:1782216844.335922:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88e682171000/0xf210a9075089e90a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089e903 expref: 17 pid: 5776 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216844.335943:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782216844.335951:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:526a4802-b871-4bcf-870f-067f11655366+17:3303:x1868789733926912:12345-0@lo:103: 00010000:00010000:3.0:1782216844.335968:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782216844.335974:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88e682171000/0xf210a9075089e90a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089e903 expref: 17 pid: 5776 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216844.335983:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88e682171000/0xf210a9075089e90a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf210a9075089e903 expref: 17 pid: 5776 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216844.335998:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88e641493000/0xf210a9075089e9dc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216844.336006:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e641493000/0xf210a9075089e9dc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1782216844.336019:0:5769:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001597180s 00010000:00010000:3.0:1782216844.336023:0:5769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88e641493000/0xf210a9075089e9dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216844.336030:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88e641493000/0xf210a9075089e9dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216844.336036:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88e641493000/0xf210a9075089e9dc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216844.336042:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88e641493000/0xf210a9075089e9dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216844.336048:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e641493000 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782216844.336052:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88e641493000/0xf210a9075089e9dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216844.336058:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88e641493000/0xf210a9075089e9dc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216844.336074:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88e641493000/0xf210a9075089e9dc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216844.336083:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782216844.336114:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:526a4802-b871-4bcf-870f-067f11655366+17:3303:x1868789733926912:12345-0@lo:103: Request processed in 164us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216844.336131:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782216844.336167:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789733926912:0@lo:103: 00010000:00010000:1.0:1782216844.336533:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e682171000/0xf210a9075089e90a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf210a9075089e903 expref: 16 pid: 5776 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216844.336553:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b96a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5799:1868789733926784:0@lo:104: 00010000:00010000:1.0:1782216844.336575:0:5799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88e641493000/0xf210a9075089e9dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216844.336583:0:5799:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88e641493000/0xf210a9075089e9dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216844.336588:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88e641493000/0xf210a9075089e9dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216844.336593:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e641493000/0xf210a9075089e9dc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216844.345370:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e65774d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+15:6575:x1868789733926656:12345-0@lo:253: Request processed in 45872us (46353us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216844.345383:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1782216844.345479:0:6575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:6575:1868789733926656:0@lo:253: 10000000:01000000:3.0:1782216844.345493:0:6575:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1782216844.345497:0:6575:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782216844.345498:0:6575:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1782216844.345500:0:6575:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782216844.345501:0:6575:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782216844.345502:0:6575:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782216844.345504:0:6575:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782216844.345505:0:6575:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782216844.345507:0:6575:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782216844.345508:0:6575:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782216844.345510:0:6575:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782216844.345511:0:6575:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1782216844.345536:0:6575:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1782216844.351232:0:6575:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1782216844.351447:0:6575:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1782216844.351693:0:6575:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1782216844.351945:0:6575:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1782216844.352152:0:6575:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1782216844.352373:0:6575:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1782216844.354069:0:6575:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1782216844.574589:0:6575:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1782216844.574596:0:6575:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1782216844.574638:0:6575:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1782216844.574692:0:6575:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.119@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1782216844.574708:0:6575:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1782216844.574733:0:6575:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1782216844.884268:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216845.908246:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216846.933082:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216847.956058:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216848.985165:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782216849.364352:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782216849.364362:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1782216849.364366:0:8:0:(import.c:65:import_set_state_nolock()) ffff88e67f309800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782216849.364374:0:8:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 163 00000100:00080000:3.0:1782216849.364379:0:8:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1782216849.364386:0:8:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff88e67f309800 using connection 192.168.203.119@tcp/0@lo 00000100:00100000:3.0:1782216849.364405:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88e67a1f1180 x1868789733927296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782216849.364448:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789733927168:0@lo:400: 00000100:00100000:3.0:1782216849.364520:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216849.364575:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782216849.364582:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1868789733927424:0@lo:400: 00000100:00100000:3.0:1782216849.364603:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216849.364637:0:3300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1868789733927296:0@lo:8: 00000100:00100000:3.0:1782216849.364662:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216849.364690:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733927168 00000100:00100000:3.0:1782216849.364697:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733927168 00000100:00100000:3.0:1782216849.364730:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733927424 00000100:00100000:3.0:1782216849.364733:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733927424 00000100:00100000:3.0:1782216849.364755:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782216849.364761:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789733927168:12345-0@lo:400: 00000100:00100000:0.0:1782216849.365046:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733927040:0@lo:400: 00000100:00100000:0.0:1782216849.365079:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216849.365115:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733927040 00000100:00100000:0.0:1782216849.365119:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733927040 00000100:00100000:0.0:1782216849.365145:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782216849.365152:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e65774c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+15:3304:x1868789733927040:12345-0@lo:400: 00000100:00100000:0.0:1782216849.365203:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e65774c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+15:3304:x1868789733927040:12345-0@lo:400: Request processed in 51us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216849.365209:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782216849.365253:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733927040:0@lo:400: 00000100:00100000:2.0:1782216849.365365:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733927296 00000100:00100000:2.0:1782216849.365369:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733927296 00000100:00100000:2.0:1782216849.365402:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782216849.365407:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3300:x1868789733927296:12345-0@lo:8: 00010000:00080000:2.0:1782216849.365430:0:6580:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 168 last 0 00000020:00000080:2.0:1782216849.365454:0:6580:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf210a9075089e9e3 00002000:00100000:2.0:1782216849.365497:0:6580:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff88e643536800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1782216849.365501:0:6580:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1782216849.365505:0:6580:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1782216849.365628:0:6580:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1782216849.365749:0:6580:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1782216849.365769:0:6580:0:(import.c:65:import_set_state_nolock()) ffff88e643534000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782216849.365811:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3300:x1868789733927296:12345-0@lo:8: Request processed in 402us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216849.365818:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782216849.365859:0:5783:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1782216849.365865:0:5783:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1782216849.365904:0:5785:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1782216849.365913:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782216849.365920:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1868789733927424:12345-0@lo:400: 00000100:00100000:2.0:1782216849.365957:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1868789733927424:12345-0@lo:400: Request processed in 38us (1353us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216849.365963:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1782216849.366191:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88e67a1f1180 x1868789733927296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782216864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216849.366201:0:3300:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782216849.366207:0:3300:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1782216849.366215:0:3300:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1782216849.366220:0:3300:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1782216849.366222:0:3300:0:(import.c:65:import_set_state_nolock()) ffff88e67f309800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1782216849.366234:0:3300:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1782216849.366239:0:3300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1868789733927296:0@lo:8: 00000100:00080000:2.0:1782216849.366258:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782216849.366291:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88e67a1f2680 x1868789733927424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216849.366302:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1868789733927424:0@lo:400: 00000004:00080000:2.0:1782216849.366326:0:6596:0:(osp_sync.c:1060:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1782216849.366776:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789733927168:12345-0@lo:400: Request processed in 2011us (2263us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216849.366785:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1782216849.366826:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88e67a1f2a00 x1868789733927168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216849.366836:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789733927168:0@lo:400: 00000004:00080000:3.0:1782216849.367353:0:6596:0:(osp_sync.c:1862:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 168419474705ns, next at 0ns, rc = 0 00000004:00080000:0.0:1782216849.409784:0:6597:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1782216849.409815:0:6597:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6597:1868789733927680:0@lo:7: 00000100:00100000:0.0:1782216849.409902:0:6597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216849.409950:0:6597:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e652c1da80 going to sleep for 11 seconds 00000100:00100000:0.0:1782216849.409973:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733927680 00000100:00100000:0.0:1782216849.409980:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733927680 00000100:00100000:1.0:1782216849.410091:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782216849.410104:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733927552:0@lo:13: 00000100:00100000:1.0:1782216849.410137:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216849.410174:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733927552 00000100:00100000:1.0:1782216849.410178:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733927552 00000100:00100000:1.0:1782216849.410208:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782216849.410216:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1868789733927552:12345-0@lo:13: 00002000:00000024:1.0:1782216849.410248:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1782216849.410290:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1868789733927552:12345-0@lo:13: Request processed in 74us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216849.410297:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1782216849.410335:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88e67a1e6a00 x1868789733927552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216865 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216849.410352:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733927552:0@lo:13: 00000100:00100000:0.0:1782216849.410419:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782216849.410427:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6597:x1868789733927680:12345-0@lo:7: 00000100:00080000:1.0:1782216849.411250:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1782216849.411296:0:5805:0:(osp_sync.c:1827:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:0.0:1782216849.419814:0:6579:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1782216849.419822:0:6579:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1782216849.420157:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6597:x1868789733927680:12345-0@lo:7: Request processed in 9728us (10252us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216849.420168:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1782216849.421732:0:6597:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88e67a1e5500 x1868789733927680/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782216865 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216849.421756:0:6597:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6597:1868789733927680:0@lo:7: 00000004:00080000:1.0:1782216849.421771:0:6597:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1782216849.421809:0:6597:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b95500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6597:1868789733927808:0@lo:5: 00000100:00100000:1.0:1782216849.421860:0:6597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216849.421970:0:6597:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e65002b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782216849.424106:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733927808 00000100:00100000:0.0:1782216849.424119:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733927808 00000100:00100000:0.0:1782216849.424178:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782216849.424188:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6597:x1868789733927808:12345-0@lo:5: 00002000:00080000:0.0:1782216849.424220:0:6578:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1782216849.424224:0:6578:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1782216849.424567:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6597:x1868789733927808:12345-0@lo:5: Request processed in 380us (2705us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1782216849.424575:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1782216849.425832:0:6597:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88e648b95500 x1868789733927808/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782216865 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216849.425849:0:6597:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b95500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6597:1868789733927808:0@lo:5: 00000004:00080000:1.0:1782216849.425862:0:6597:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1782216849.425918:0:6597:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b96680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6597:1868789733927936:0@lo:700: 00000100:00100000:1.0:1782216849.425960:0:6597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216849.425994:0:6597:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e65002b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782216849.426028:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733927936 00000100:00100000:1.0:1782216849.426034:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733927936 00000100:00100000:1.0:1782216849.426070:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782216849.426077:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6597:x1868789733927936:12345-0@lo:700: 00000100:00100000:1.0:1782216849.426109:0:6586:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6586:1868789733928064:0@lo:700: 00000100:00100000:1.0:1782216849.426139:0:6586:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216849.426155:0:6586:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e65002b840 going to sleep for 11 seconds 00000100:00100000:1.0:1782216849.426175:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733928064 00000100:00100000:1.0:1782216849.426178:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733928064 00000100:00100000:1.0:1782216849.426202:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782216849.426208:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6586:x1868789733928064:12345-0@lo:700: 40000000:02000000:2.0:1782216849.481369:0:5790:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1782216849.495098:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6586:x1868789733928064:12345-0@lo:700: Request processed in 68880us (68948us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216849.495116:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1782216849.497467:0:6586:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88e648b94e00 x1868789733928064/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1782216865 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216849.497492:0:6586:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6586:1868789733928064:0@lo:700: 40000000:02000000:1.0:1782216849.497506:0:6586:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:3.0:1782216849.606232:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6597:x1868789733927936:12345-0@lo:700: Request processed in 180145us (180261us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216849.606250:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:3.0:1782216849.606286:0:6609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1782216849.606301:0:6609:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:3.0:1782216849.606338:0:6597:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88e648b96680 x1868789733927936/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1782216865 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216849.606353:0:6597:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b96680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6597:1868789733927936:0@lo:700: 00000004:02000040:3.0:1782216849.674229:0:6597:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1782216849.679427:0:6597:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6597:1868789733928192:0@lo:5: 00000100:00100000:3.0:1782216849.679494:0:6597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216849.679637:0:6597:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e66445ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1782216849.685132:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733928192 00000100:00100000:1.0:1782216849.685147:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733928192 00000100:00100000:3.0:1782216849.685335:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782216849.685346:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6597:x1868789733928192:12345-0@lo:5: 00002000:00080000:3.0:1782216849.695545:0:6579:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1782216849.695577:0:6579:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1782216849.702032:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6597:x1868789733928192:12345-0@lo:5: Request processed in 16680us (22529us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1782216849.702948:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1782216849.703802:0:6597:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88e67a1f2a00 x1868789733928192/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782216865 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216849.703823:0:6597:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1782216849.703838:0:6597:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff88e67a1f2a00 x1868789733928192/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782216865 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216849.703849:0:6597:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6597:1868789733928192:0@lo:5: 00000004:00080000:0.0:1782216849.703862:0:6597:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1782216850.004071:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782216850.743617:0:6951:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg319-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1782216851.028038:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782216851.924382:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1782216851.924390:0:5780:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff88e650a2a800 from 4 10000000:01000000:3.0:1782216851.924395:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1782216851.924444:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e653161200/0xf210a9075089e9ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216851.924456:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e653161200/0xf210a9075089e9ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216851.924486:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e653161200/0xf210a9075089e9ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216851.924522:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733928320:0@lo:101: 00000100:00100000:3.0:1782216851.924691:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216851.924749:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e66445e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782216851.924984:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733928320 00000100:00100000:2.0:1782216851.924993:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733928320 00000100:00100000:2.0:1782216851.925049:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1782216851.925059:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e65774e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+15:5780:x1868789733928320:12345-0@lo:101: 00010000:00010000:2.0:1782216851.925074:0:5775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216851.925089:0:5775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e682170400/0xf210a9075089e9f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089e9ea expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216851.925111:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e682170400/0xf210a9075089e9f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089e9ea expref: 16 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216851.925123:0:5775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e682170400/0xf210a9075089e9f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089e9ea expref: 16 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216851.925142:0:5775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e682170400, rc 0) 00000100:00100000:2.0:1782216851.925183:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e65774e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+16:5780:x1868789733928320:12345-0@lo:101: Request processed in 126us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216851.925191:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782216851.925293:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733928320:0@lo:101: 00010000:00010000:3.0:1782216851.925307:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e653161200/0xf210a9075089e9ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e9f1 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216851.925316:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e653161200/0xf210a9075089e9ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089e9f1 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216851.925362:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733928448:0@lo:256: 00000100:00100000:3.0:1782216851.925393:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216851.925420:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e66445e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782216851.926332:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733928448 00000100:00100000:2.0:1782216851.926340:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733928448 00000100:00100000:2.0:1782216851.926376:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1782216851.926385:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e65774f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+16:5780:x1868789733928448:12345-0@lo:256: 20000000:01000000:2.0:1782216851.926403:0:5776:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1782216851.926418:0:5776:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1782216851.926421:0:5776:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1782216851.926528:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e65774f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+16:5780:x1868789733928448:12345-0@lo:256: Request processed in 144us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216851.926536:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1782216851.927897:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733928448:0@lo:256: 10000000:01000000:3.0:1782216851.927966:0:5780:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1782216851.927976:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e653161200/0xf210a9075089e9ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e9f1 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216851.927987:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e653161200/0xf210a9075089e9ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e9f1 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216852.052334:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216853.076030:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216854.100101:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216854.484061:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782216854.484094:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733928576:0@lo:13: 00000100:00100000:3.0:1782216854.484159:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216854.484309:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733928576 00000100:00100000:1.0:1782216854.484317:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733928576 00000100:00100000:1.0:1782216854.484384:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782216854.484393:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1868789733928576:12345-0@lo:13: 00002000:00000024:1.0:1782216854.484425:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782216854.484469:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1868789733928576:12345-0@lo:13: Request processed in 78us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216854.484487:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1782216854.484543:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782216854.484607:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88e648b94e00 x1868789733928576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216870 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216854.484625:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733928576:0@lo:13: 00000100:00100000:2.0:1782216854.485052:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782216854.485062:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1868789733928960:0@lo:400: 00000100:00100000:2.0:1782216854.485106:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216854.485134:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733928960 00000100:00100000:2.0:1782216854.485139:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733928960 00000100:00100000:2.0:1782216854.485173:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782216854.485179:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868789733928960:12345-0@lo:400: 00000100:00100000:2.0:1782216854.485216:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868789733928960:12345-0@lo:400: Request processed in 37us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216854.485222:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1782216854.485239:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782216854.485262:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88e652482680 x1868789733928960/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216854.485272:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1868789733928960:0@lo:400: 00000100:00100000:3.0:1782216854.485326:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:526a4802-b871-4bcf-870f-067f11655366:3301:1868789733928704:0@lo:400: 00000100:00100000:3.0:1782216854.485357:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216854.485389:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782216854.485395:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789733928832:0@lo:400: 00000100:00100000:3.0:1782216854.485416:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216854.485483:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733928704 00000100:00100000:2.0:1782216854.485487:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733928704 00000100:00100000:2.0:1782216854.485519:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1782216854.485526:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e68044f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+16:3301:x1868789733928704:12345-0@lo:400: 00000100:00100000:2.0:1782216854.485560:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e68044f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+16:3301:x1868789733928704:12345-0@lo:400: Request processed in 34us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216854.485566:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1782216854.485590:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733928832 00000100:00100000:2.0:1782216854.485593:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733928832 00000100:00100000:2.0:1782216854.485612:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782216854.485618:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789733928832:12345-0@lo:400: 00000100:00100000:2.0:1782216854.485644:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789733928832:12345-0@lo:400: Request processed in 26us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216854.485649:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1782216854.485712:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88e652481180 x1868789733928832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216854.485721:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789733928832:0@lo:400: 00000100:00100000:3.0:1782216854.485729:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:526a4802-b871-4bcf-870f-067f11655366:3301:1868789733928704:0@lo:400: 00000001:00080000:1.0:1782216855.078506:0:6609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1782216855.125524:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216856.151434:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216857.171977:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216858.200139:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216859.223691:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216859.607750:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733929088:0@lo:400: 00000100:00100000:0.0:1782216859.607833:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216859.607912:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782216859.607919:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1868789733929472:0@lo:400: 00000100:00100000:0.0:1782216859.608200:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216859.608233:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789733929216:0@lo:400: 00000100:00100000:0.0:1782216859.608256:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216859.608272:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782216859.608278:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733929344:0@lo:400: 00000100:00100000:0.0:1782216859.608303:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216859.610053:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733929472 00000100:00100000:2.0:1782216859.610063:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733929472 00000100:00100000:2.0:1782216859.610128:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733929216 00000100:00100000:2.0:1782216859.610131:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733929216 00000100:00100000:2.0:1782216859.610155:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782216859.610163:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868789733929472:12345-0@lo:400: 00000100:00100000:2.0:1782216859.610237:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868789733929472:12345-0@lo:400: Request processed in 74us (2036us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216859.610244:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782216859.610258:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782216859.610271:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789733929216:12345-0@lo:400: 00000100:00100000:2.0:1782216859.610303:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789733929216:12345-0@lo:400: Request processed in 33us (2047us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216859.610320:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782216859.610341:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733929344 00000100:00100000:2.0:1782216859.610344:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733929344 00000100:00100000:2.0:1782216859.610366:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782216859.610372:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733929344:12345-0@lo:400: 00000100:00100000:2.0:1782216859.610401:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733929344:12345-0@lo:400: Request processed in 29us (2098us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216859.610407:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1782216859.610521:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782216859.610527:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782216859.610853:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88e67a1e6a00 x1868789733929472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216859.610869:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1868789733929472:0@lo:400: 00010000:00080000:2.0:1782216859.610924:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88e67a1e5500 x1868789733929344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216859.611373:0:3301:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1782216859.611388:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733929344:0@lo:400: 00010000:00080000:2.0:1782216859.611405:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88e67a1e6300 x1868789733929216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216859.611860:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789733929216:0@lo:400: 00000100:00100000:3.0:1782216859.612393:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733929088 00000100:00100000:3.0:1782216859.612400:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733929088 00000100:00100000:0.0:1782216859.612599:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782216859.612613:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733929600:0@lo:13: 00000100:00100000:0.0:1782216859.612664:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216859.612699:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733929600 00000100:00100000:0.0:1782216859.612702:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733929600 00000100:00100000:0.0:1782216859.612732:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782216859.612737:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733929600:12345-0@lo:13: 00002000:00000024:0.0:1782216859.612765:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782216859.612820:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733929600:12345-0@lo:13: Request processed in 82us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216859.612827:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1782216859.612864:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88e67a1e7100 x1868789733929600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216875 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216859.613207:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733929600:0@lo:13: 00000100:00100000:3.0:1782216859.613593:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1782216859.613602:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e68044d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+16:3304:x1868789733929088:12345-0@lo:400: 00000100:00100000:3.0:1782216859.613647:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e68044d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+16:3304:x1868789733929088:12345-0@lo:400: Request processed in 46us (5814us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216859.613652:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1782216859.613695:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733929088:0@lo:400: 00010000:00010000:3.0:1782216860.245334:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1782216860.576572:0:7470:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1782216860.576576:0:7470:0:(obd_mount.c:917:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1782216860.576775:0:7470:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff88e64853e800 00000020:01000004:2.0:1782216860.576789:0:7470:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1782216860.576801:0:7470:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1782216860.576824:0:7470:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff88e674084d40) 00000020:00000080:2.0:1782216860.576839:0:7470:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1782216860.594465:0:7470:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1782216860.595043:0:7470:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1782216860.613584:0:7470:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1782216860.617980:0:7470:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1782216860.618016:0:7470:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1782216860.618071:0:7470:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1782216860.618097:0:7470:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1782216860.618424:0:7470:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1782216860.618446:0:7470:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1782216860.618456:0:7470:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf210a9075089e9ff 00000020:01000004:1.0:1782216860.618463:0:7470:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1782216860.618481:0:7470:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.119@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1782216860.618484:0:7470:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.119@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1782216860.618489:0:7470:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1782216860.618516:0:7470:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1782216860.618520:0:7470:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.119@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1782216860.642202:0:7470:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.119@tcp ctxt 0 is initialized 00000020:01000004:0.0:1782216860.642241:0:7470:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.119@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1782216860.642245:0:7470:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1782216860.642247:0:7470:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782216860.642248:0:7470:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782216860.642250:0:7470:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782216860.642251:0:7470:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782216860.642252:0:7470:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782216860.642254:0:7470:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782216860.642255:0:7470:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782216860.642257:0:7470:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782216860.642258:0:7470:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782216860.642260:0:7470:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782216860.642263:0:7470:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1782216860.642265:0:7470:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782216860.642266:0:7470:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782216860.642267:0:7470:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782216860.642268:0:7470:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782216860.642269:0:7470:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782216860.642270:0:7470:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782216860.642271:0:7470:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782216860.642272:0:7470:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782216860.642273:0:7470:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782216860.642274:0:7470:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782216860.642275:0:7470:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782216860.642300:0:7470:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1782216860.642318:0:7470:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:7470:1868789733929728:0@lo:253: 00000100:00100000:0.0:1782216860.642394:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216860.642520:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733929728 00000100:00100000:3.0:1782216860.642527:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733929728 00000100:00100000:3.0:1782216860.642583:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1782216860.642592:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e68044c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+16:7470:x1868789733929728:12345-0@lo:253: 20000000:01000000:3.0:1782216860.642622:0:5776:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1782216860.642626:0:5776:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1782216860.642631:0:5776:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1782216860.642635:0:5776:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1782216860.643541:0:5776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782216860.643758:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1782216860.643774:0:5776:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1782216860.643809:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1782216860.643816:0:5776:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1782216860.643845:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1782216860.643932:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1782216860.644281:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1782216860.644300:0:5776:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.203.119@tcp 20000000:01000000:3.0:1782216860.644301:0:5776:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.119@tcp (null) (null) (null) 00000040:00080000:3.0:1782216860.644354:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1782216860.644362:0:5776:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1782216860.644404:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1782216860.644412:0:5776:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.119@tcp (null) (null) 00000040:00080000:3.0:1782216860.644458:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1782216860.644468:0:5776:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1782216860.644498:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1782216860.644541:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1782216860.645255:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1782216860.645273:0:5776:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.203.119@tcp 20000000:01000000:3.0:1782216860.645274:0:5776:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.119@tcp (null) (null) (null) 00000040:00080000:3.0:1782216860.645309:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1782216860.645317:0:5776:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1782216860.645345:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1782216860.645351:0:5776:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.119@tcp (null) (null) 00000040:00080000:3.0:1782216860.645389:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1782216860.645397:0:5776:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000100:00100000:0.0:1782216860.645543:0:7470:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e66df00600 going to sleep for 11 seconds 00000040:00080000:3.0:1782216860.649129:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1782216860.649227:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1782216860.649251:0:5776:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1782216860.649254:0:5776:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1782216860.649259:0:5776:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1782216860.649272:0:5776:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1782216860.649274:0:5776:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1782216860.649316:0:5776:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1782216860.649319:0:5776:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1782216860.650604:0:7473:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1782216860.650689:0:7473:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1782216860.650723:0:7473:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1782216860.651043:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1782216860.651085:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1782216860.651133:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1782216860.651145:0:5776:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1782216860.651147:0:5776:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1782216860.651714:0:7474:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1782216860.651782:0:7474:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1782216860.651838:0:7474:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1782216860.652480:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1782216860.652522:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1782216860.652584:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1782216860.652598:0:5776:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1782216860.652600:0:5776:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1782216860.653236:0:7475:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1782216860.653453:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1782216860.653494:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1782216860.653549:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1782216860.653561:0:5776:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1782216860.653563:0:5776:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1782216860.654330:0:7476:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1782216860.654376:0:7476:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1782216860.654437:0:7476:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1782216860.654694:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1782216860.654736:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1782216860.654784:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1782216860.654798:0:5776:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1782216860.654800:0:5776:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1782216860.654809:0:5776:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1782216860.654828:0:5776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88e653161c00/0xf210a9075089ea06 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216860.654846:0:5776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88e682171200/0xf210a9075089e93b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089e934 expref: 16 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216860.655107:0:5776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88e653160e00/0xf210a9075089e949 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089e942 expref: 16 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216860.655127:0:5776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88e641493a00/0xf210a9075089e97a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089e973 expref: 16 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216860.655134:0:5776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88e682171400/0xf210a9075089e996 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089e98f expref: 16 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216860.655141:0:5776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88e653161e00/0xf210a9075089e9c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089e9b9 expref: 16 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216860.655148:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88e653161c00/0xf210a9075089ea06 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216860.655185:0:5776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88e653161e00/0xf210a9075089e9c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf210a9075089e9b9 expref: 16 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216860.655198:0:5776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88e653161e00/0xf210a9075089e9c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf210a9075089e9b9 expref: 16 pid: 5778 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216860.655214:0:5776:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f2a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5776:1868789733929856:0@lo:104: 00000100:00100000:3.0:1782216860.655279:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782216860.655367:0:5776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88e682171400/0xf210a9075089e996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf210a9075089e98f expref: 16 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216860.655375:0:5776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88e682171400/0xf210a9075089e996 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf210a9075089e98f expref: 16 pid: 5776 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216860.655383:0:5776:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5776:1868789733929984:0@lo:104: 00000100:00100000:3.0:1782216860.655403:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782216860.655487:0:5776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88e641493a00/0xf210a9075089e97a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf210a9075089e973 expref: 16 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216860.655502:0:5776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88e641493a00/0xf210a9075089e97a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf210a9075089e973 expref: 16 pid: 5778 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216860.655511:0:5776:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f3100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5776:1868789733930112:0@lo:104: 00000100:00100000:3.0:1782216860.655533:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216860.655603:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733929856 00000100:00100000:2.0:1782216860.655610:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733929856 00000100:00100000:2.0:1782216860.655654:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733929984 00000100:00100000:2.0:1782216860.655657:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733929984 00000100:00100000:2.0:1782216860.655671:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782216860.655678:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:526a4802-b871-4bcf-870f-067f11655366+4:5776:x1868789733929856:12345-0@lo:104: 00010000:00010000:2.0:1782216860.655690:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.119@tcp lock: ffff88e682171600/0xf210a9075089e9b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089e9c0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.655736:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782216860.655742:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:526a4802-b871-4bcf-870f-067f11655366+4:5776:x1868789733929856:12345-0@lo:104: Request processed in 64us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216860.655760:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782216860.655775:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782216860.655781:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:526a4802-b871-4bcf-870f-067f11655366+3:5776:x1868789733929984:12345-0@lo:104: 00010000:00010000:2.0:1782216860.655787:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.119@tcp lock: ffff88e640030a00/0xf210a9075089e98f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089e996 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.655823:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782216860.655828:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:526a4802-b871-4bcf-870f-067f11655366+3:5776:x1868789733929984:12345-0@lo:104: Request processed in 48us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216860.655833:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1782216860.655860:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782216860.655865:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e682171600/0xf210a9075089e9b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089e9c0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.655872:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e682171600 already unused, calling callback (ffffffffc1d2fc20) 10000000:00010000:2.0:1782216860.655894:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e682171600/0xf210a9075089e9b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf210a9075089e9c0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.655902:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e682171600/0xf210a9075089e9b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf210a9075089e9c0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782216860.655908:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e682171600/0xf210a9075089e9b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf210a9075089e9c0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216860.655914:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782216860.655940:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: ffff88e682171600/0xf210a9075089e9b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e9c0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.655946:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782216860.655963:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e682171600/0xf210a9075089e9b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e9c0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.655970:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e682171600/0xf210a9075089e9b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e9c0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.655996:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782216860.655999:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e640030a00/0xf210a9075089e98f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089e996 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.656006:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640030a00 already unused, calling callback (ffffffffc1d2fc20) 10000000:00010000:2.0:1782216860.656008:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e640030a00/0xf210a9075089e98f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf210a9075089e996 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.656016:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e640030a00/0xf210a9075089e98f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf210a9075089e996 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782216860.656022:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e640030a00/0xf210a9075089e98f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf210a9075089e996 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216860.656027:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782216860.656041:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: ffff88e640030a00/0xf210a9075089e98f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e996 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.656047:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782216860.656052:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e640030a00/0xf210a9075089e98f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e996 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.656057:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e640030a00/0xf210a9075089e98f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e996 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.656066:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216860.656068:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216860.656070:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216860.656078:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216860.656107:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:526a4802-b871-4bcf-870f-067f11655366:3301:1868789733930240:0@lo:103: 00000100:00100000:2.0:1782216860.656136:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216860.656172:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782216860.656178:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:526a4802-b871-4bcf-870f-067f11655366:3301:1868789733930368:0@lo:103: 00000100:00100000:2.0:1782216860.656198:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216860.656226:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733930240 00000100:00100000:2.0:1782216860.656230:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733930240 00010000:00010000:2.0:1782216860.656246:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88e653161e00/0xf210a9075089e9c0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089e9b9 expref: 17 pid: 5778 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216860.656264:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733930368 00000100:00100000:2.0:1782216860.656267:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733930368 00010000:00010000:2.0:1782216860.656276:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88e682171400/0xf210a9075089e996 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089e98f expref: 18 pid: 5776 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216860.656286:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782216860.656292:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e644799850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:526a4802-b871-4bcf-870f-067f11655366+18:3301:x1868789733930240:12345-0@lo:103: 00010000:00010000:2.0:1782216860.656301:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782216860.656306:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88e653161e00/0xf210a9075089e9c0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089e9b9 expref: 18 pid: 5778 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.656316:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88e653161e00/0xf210a9075089e9c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf210a9075089e9b9 expref: 18 pid: 5778 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.656331:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782216860.656355:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e644799850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:526a4802-b871-4bcf-870f-067f11655366+18:3301:x1868789733930240:12345-0@lo:103: Request processed in 63us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216860.656362:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782216860.656392:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782216860.656398:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652481500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:526a4802-b871-4bcf-870f-067f11655366+17:3301:x1868789733930368:12345-0@lo:103: 00010000:00010000:2.0:1782216860.656411:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782216860.656415:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88e682171400/0xf210a9075089e996 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089e98f expref: 17 pid: 5776 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.656424:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88e682171400/0xf210a9075089e996 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf210a9075089e98f expref: 17 pid: 5776 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.656445:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782216860.656465:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652481500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:526a4802-b871-4bcf-870f-067f11655366+17:3301:x1868789733930368:12345-0@lo:103: Request processed in 67us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216860.656471:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782216860.656500:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:526a4802-b871-4bcf-870f-067f11655366:3301:1868789733930368:0@lo:103: 00000100:00100000:2.0:1782216860.656508:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:526a4802-b871-4bcf-870f-067f11655366:3301:1868789733930240:0@lo:103: 00010000:00010000:3.0:1782216860.656821:0:5776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88e653160e00/0xf210a9075089e949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf210a9075089e942 expref: 16 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216860.656831:0:5776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88e653160e00/0xf210a9075089e949 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf210a9075089e942 expref: 16 pid: 5778 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216860.656841:0:5776:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f1f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5776:1868789733930496:0@lo:104: 00000100:00100000:3.0:1782216860.656873:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782216860.657183:0:5776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88e682171200/0xf210a9075089e93b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf210a9075089e934 expref: 16 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216860.657192:0:5776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88e682171200/0xf210a9075089e93b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf210a9075089e934 expref: 16 pid: 5778 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216860.657202:0:5776:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5776:1868789733930624:0@lo:104: 00000100:00100000:3.0:1782216860.657224:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216860.657287:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733930112 00000100:00100000:1.0:1782216860.657292:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733930112 00000100:00100000:1.0:1782216860.657314:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733930496 00000100:00100000:1.0:1782216860.657317:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733930496 00000100:00100000:1.0:1782216860.657328:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782216860.657334:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:526a4802-b871-4bcf-870f-067f11655366+4:5776:x1868789733930112:12345-0@lo:104: 00010000:00010000:1.0:1782216860.657343:0:6593:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.119@tcp lock: ffff88e641492800/0xf210a9075089e973 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089e97a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216860.657382:0:6593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782216860.657388:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:526a4802-b871-4bcf-870f-067f11655366+4:5776:x1868789733930112:12345-0@lo:104: Request processed in 54us (1854us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216860.657394:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782216860.657406:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782216860.657412:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:526a4802-b871-4bcf-870f-067f11655366+3:5776:x1868789733930496:12345-0@lo:104: 00010000:00010000:1.0:1782216860.657419:0:6593:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.119@tcp lock: ffff88e682170600/0xf210a9075089e942 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089e949 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216860.657579:0:6593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782216860.657584:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:526a4802-b871-4bcf-870f-067f11655366+3:5776:x1868789733930496:12345-0@lo:104: Request processed in 172us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216860.657599:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1782216860.657665:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782216860.657670:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e641492800/0xf210a9075089e973 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089e97a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.657677:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e641492800 already unused, calling callback (ffffffffc1d2fc20) 10000000:00010000:2.0:1782216860.657680:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e641492800/0xf210a9075089e973 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf210a9075089e97a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.657689:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e641492800/0xf210a9075089e973 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf210a9075089e97a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782216860.657696:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e641492800/0xf210a9075089e973 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf210a9075089e97a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216860.657702:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782216860.657732:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: ffff88e641492800/0xf210a9075089e973 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e97a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.657743:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782216860.658109:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e641492800/0xf210a9075089e973 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e97a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.658116:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e641492800/0xf210a9075089e973 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e97a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.658132:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782216860.658135:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e682170600/0xf210a9075089e942 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089e949 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.658140:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e682170600 already unused, calling callback (ffffffffc1d2fc20) 10000000:00010000:2.0:1782216860.658142:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e682170600/0xf210a9075089e942 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf210a9075089e949 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.658148:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e682170600/0xf210a9075089e942 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf210a9075089e949 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782216860.658153:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e682170600/0xf210a9075089e942 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf210a9075089e949 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216860.658158:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782216860.658172:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: ffff88e682170600/0xf210a9075089e942 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e949 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.658177:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782216860.658182:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e682170600/0xf210a9075089e942 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e949 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.658187:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e682170600/0xf210a9075089e942 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e949 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.658203:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216860.658205:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216860.658206:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216860.658218:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789733930752:0@lo:103: 00000100:00100000:2.0:1782216860.658247:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216860.658267:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782216860.658272:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789733930880:0@lo:103: 00000100:00100000:2.0:1782216860.658290:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216860.658316:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733930752 00000100:00100000:2.0:1782216860.658322:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733930752 00010000:00010000:2.0:1782216860.658341:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88e641493a00/0xf210a9075089e97a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089e973 expref: 17 pid: 5778 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216860.658360:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733930880 00000100:00100000:2.0:1782216860.658363:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733930880 00010000:00010000:2.0:1782216860.658372:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88e653160e00/0xf210a9075089e949 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089e942 expref: 18 pid: 5778 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216860.658383:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782216860.658388:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652480700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:526a4802-b871-4bcf-870f-067f11655366+18:3303:x1868789733930752:12345-0@lo:103: 00010000:00010000:2.0:1782216860.658395:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782216860.658399:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88e641493a00/0xf210a9075089e97a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089e973 expref: 18 pid: 5778 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.658407:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88e641493a00/0xf210a9075089e97a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf210a9075089e973 expref: 18 pid: 5778 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.658419:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782216860.658466:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652480700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:526a4802-b871-4bcf-870f-067f11655366+18:3303:x1868789733930752:12345-0@lo:103: Request processed in 76us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216860.658472:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782216860.658484:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782216860.658490:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652481880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:526a4802-b871-4bcf-870f-067f11655366+17:3303:x1868789733930880:12345-0@lo:103: 00010000:00010000:2.0:1782216860.658497:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782216860.658501:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88e653160e00/0xf210a9075089e949 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089e942 expref: 17 pid: 5778 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.658510:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88e653160e00/0xf210a9075089e949 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf210a9075089e942 expref: 17 pid: 5778 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.658519:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782216860.658539:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652481880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:526a4802-b871-4bcf-870f-067f11655366+17:3303:x1868789733930880:12345-0@lo:103: Request processed in 50us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216860.658545:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782216860.658574:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789733930880:0@lo:103: 00000100:00100000:2.0:1782216860.658581:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789733930752:0@lo:103: 00010000:00010000:2.0:1782216860.658597:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216860.658759:0:5776:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e67a2d4480 going to sleep for 11 seconds 00010000:00010000:3.0:1782216860.658774:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e653161e00/0xf210a9075089e9c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf210a9075089e9b9 expref: 16 pid: 5778 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216860.658785:0:5776:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f2a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5776:1868789733929856:0@lo:104: 00010000:00010000:3.0:1782216860.658794:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e682171400/0xf210a9075089e996 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf210a9075089e98f expref: 15 pid: 5776 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216860.658815:0:5776:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5776:1868789733929984:0@lo:104: 00010000:00010000:3.0:1782216860.658826:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e641493a00/0xf210a9075089e97a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf210a9075089e973 expref: 14 pid: 5778 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216860.658844:0:5776:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f3100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5776:1868789733930112:0@lo:104: 00010000:00010000:3.0:1782216860.659054:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e653160e00/0xf210a9075089e949 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf210a9075089e942 expref: 13 pid: 5778 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216860.659065:0:5776:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f1f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5776:1868789733930496:0@lo:104: 00000100:00100000:2.0:1782216860.659144:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733930624 00000100:00100000:2.0:1782216860.659148:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733930624 00000100:00100000:2.0:1782216860.659180:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782216860.659187:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:526a4802-b871-4bcf-870f-067f11655366+3:5776:x1868789733930624:12345-0@lo:104: 00010000:00010000:2.0:1782216860.659198:0:6593:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.119@tcp lock: ffff88e641492a00/0xf210a9075089e934 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089e93b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.659246:0:6593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782216860.659251:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:526a4802-b871-4bcf-870f-067f11655366+3:5776:x1868789733930624:12345-0@lo:104: Request processed in 65us (2027us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216860.659263:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1782216860.659276:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782216860.659280:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e641492a00/0xf210a9075089e934 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089e93b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.659288:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e641492a00 already unused, calling callback (ffffffffc1d2fc20) 10000000:00010000:2.0:1782216860.659291:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e641492a00/0xf210a9075089e934 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf210a9075089e93b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.659299:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e641492a00/0xf210a9075089e934 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf210a9075089e93b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782216860.659306:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e641492a00/0xf210a9075089e934 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf210a9075089e93b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216860.659311:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782216860.659334:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: ffff88e641492a00/0xf210a9075089e934 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e93b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.659340:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782216860.659352:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e641492a00/0xf210a9075089e934 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e93b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.659359:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e641492a00/0xf210a9075089e934 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e93b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.659372:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216860.659374:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216860.659376:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216860.659381:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782216860.659395:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:526a4802-b871-4bcf-870f-067f11655366:3302:1868789733931008:0@lo:103: 00000100:00100000:2.0:1782216860.659420:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216860.659464:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733931008 00000100:00100000:2.0:1782216860.659467:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733931008 00010000:00010000:2.0:1782216860.659478:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88e682171200/0xf210a9075089e93b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089e934 expref: 13 pid: 5778 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216860.659495:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782216860.659500:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652480e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:526a4802-b871-4bcf-870f-067f11655366+13:3302:x1868789733931008:12345-0@lo:103: 00010000:00010000:2.0:1782216860.659508:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782216860.659513:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88e682171200/0xf210a9075089e93b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089e934 expref: 13 pid: 5778 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.659522:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88e682171200/0xf210a9075089e93b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf210a9075089e934 expref: 13 pid: 5778 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.659535:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88e653161c00/0xf210a9075089ea06 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.659543:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e653161c00/0xf210a9075089ea06 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.659557:0:5770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88e653161c00/0xf210a9075089ea06 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.659564:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88e653161c00/0xf210a9075089ea06 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.659571:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88e653161c00/0xf210a9075089ea06 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.659577:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88e653161c00/0xf210a9075089ea06 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.659588:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e653161c00 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:2.0:1782216860.659592:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88e653161c00/0xf210a9075089ea06 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.659599:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88e653161c00/0xf210a9075089ea06 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.659607:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88e653161c00/0xf210a9075089ea06 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.659617:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782216860.659644:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652480e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:526a4802-b871-4bcf-870f-067f11655366+13:3302:x1868789733931008:12345-0@lo:103: Request processed in 143us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216860.659650:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782216860.659677:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:526a4802-b871-4bcf-870f-067f11655366:3302:1868789733931008:0@lo:103: 00010000:00010000:1.0:1782216860.659741:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e682171200/0xf210a9075089e93b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf210a9075089e934 expref: 12 pid: 5778 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216860.659750:0:5776:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5776:1868789733930624:0@lo:104: 00010000:00010000:1.0:1782216860.659770:0:5776:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88e653161c00/0xf210a9075089ea06 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216860.659779:0:5776:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88e653161c00/0xf210a9075089ea06 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216860.659784:0:5776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88e653161c00/0xf210a9075089ea06 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216860.659790:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e653161c00/0xf210a9075089ea06 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782216860.659801:0:5776:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1782216860.698759:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e68044c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+11:7470:x1868789733929728:12345-0@lo:253: Request processed in 56159us (56356us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216860.698774:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1782216860.698906:0:7470:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:7470:1868789733929728:0@lo:253: 10000000:01000000:2.0:1782216860.698922:0:7470:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1782216860.699043:0:7470:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782216860.699045:0:7470:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782216860.699047:0:7470:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782216860.699048:0:7470:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1782216860.699049:0:7470:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782216860.699051:0:7470:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782216860.699052:0:7470:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782216860.699054:0:7470:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1782216860.699056:0:7470:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782216860.699058:0:7470:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1782216860.699078:0:7470:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88e64853e800 from lustre-OST0001 10000000:01000000:2.0:1782216860.699102:0:7470:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1782216860.699105:0:7470:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1782216860.699126:0:7470:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff88e6484dcd40 local copy 10000000:01000000:2.0:1782216860.699131:0:7470:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1782216860.699168:0:7470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3a00/0xf210a9075089ea0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.699178:0:7470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3a00/0xf210a9075089ea0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.699188:0:7470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3a00/0xf210a9075089ea0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216860.699208:0:7470:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:7470:1868789733931136:0@lo:101: 00000100:00100000:2.0:1782216860.699255:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216860.699289:0:7470:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6485f9600 going to sleep for 11 seconds 00000100:00100000:0.0:1782216860.699422:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733931136 00000100:00100000:0.0:1782216860.699438:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733931136 00000100:00100000:0.0:1782216860.699481:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1782216860.699489:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e68044e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+11:7470:x1868789733931136:12345-0@lo:101: 00010000:00010000:0.0:1782216860.699501:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216860.699513:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e640030200/0xf210a9075089ea14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089ea0d expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.699534:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e640030200/0xf210a9075089ea14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089ea0d expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.699543:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e640030200/0xf210a9075089ea14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089ea0d expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.699551:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e640030200, rc 0) 00000100:00100000:0.0:1782216860.699587:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e68044e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+12:7470:x1868789733931136:12345-0@lo:101: Request processed in 98us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216860.699593:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1782216860.699693:0:7470:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:7470:1868789733931136:0@lo:101: 00010000:00010000:2.0:1782216860.699706:0:7470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3a00/0xf210a9075089ea0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf210a9075089ea14 expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.699715:0:7470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3a00/0xf210a9075089ea0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf210a9075089ea14 expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216860.699802:0:7470:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:7470:1868789733931264:0@lo:501: 00000100:00100000:2.0:1782216860.699826:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216860.699846:0:7470:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6485f9600 going to sleep for 11 seconds 00000100:00100000:0.0:1782216860.700044:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733931264 00000100:00100000:0.0:1782216860.700048:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733931264 00000100:00100000:0.0:1782216860.700079:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1782216860.700086:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e68044f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+12:7470:x1868789733931264:12345-0@lo:501: 00000100:00100000:0.0:1782216860.700278:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e68044f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+12:7470:x1868789733931264:12345-0@lo:501: Request processed in 191us (450us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782216860.700284:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1782216860.700452:0:7470:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:7470:1868789733931264:0@lo:501: 10000000:01000000:2.0:1782216860.700464:0:7470:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.119@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1782216860.700491:0:7470:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.119@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1782216860.700496:0:7470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3a00/0xf210a9075089ea0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf210a9075089ea14 expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.700513:0:7470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3a00/0xf210a9075089ea0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf210a9075089ea14 expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.700519:0:7470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3a00/0xf210a9075089ea0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf210a9075089ea14 expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.700534:0:7470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1782216860.700553:0:7470:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88e64853e800 10000000:01000000:2.0:1782216860.700558:0:7470:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1782216860.700563:0:7470:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1782216860.700565:0:7470:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782216860.700569:0:7470:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1782216860.700572:0:7470:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1782216860.700590:0:7470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3000/0xf210a9075089ea1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.700597:0:7470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3000/0xf210a9075089ea1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.700604:0:7470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3000/0xf210a9075089ea1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216860.700617:0:7470:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:7470:1868789733931392:0@lo:101: 00000100:00100000:2.0:1782216860.700643:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216860.700670:0:7470:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6485f9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782216860.700713:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733931392 00000100:00100000:1.0:1782216860.700718:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733931392 00000100:00100000:1.0:1782216860.700752:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1782216860.700759:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e68044f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+12:7470:x1868789733931392:12345-0@lo:101: 00010000:00010000:1.0:1782216860.700767:0:5775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782216860.700777:0:5775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e641492600/0xf210a9075089ea22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089ea1b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216860.700792:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e641492600/0xf210a9075089ea22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089ea1b expref: 13 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216860.700800:0:5775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e641492600/0xf210a9075089ea22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089ea1b expref: 13 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216860.700813:0:5775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e641492600, rc 0) 00000100:00100000:1.0:1782216860.700842:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e68044f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+13:7470:x1868789733931392:12345-0@lo:101: Request processed in 83us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216860.700848:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1782216860.701075:0:7470:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:7470:1868789733931392:0@lo:101: 00010000:00010000:2.0:1782216860.701086:0:7470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3000/0xf210a9075089ea1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ea22 expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.701105:0:7470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3000/0xf210a9075089ea1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089ea22 expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216860.701164:0:7470:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:7470:1868789733931520:0@lo:501: 00000100:00100000:2.0:1782216860.701189:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216860.701215:0:7470:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6485f9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782216860.701309:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733931520 00000100:00100000:1.0:1782216860.701313:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733931520 00000100:00100000:1.0:1782216860.701338:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1782216860.701345:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e68044d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+13:7470:x1868789733931520:12345-0@lo:501: 00000100:00100000:1.0:1782216860.701557:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e68044d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+13:7470:x1868789733931520:12345-0@lo:501: Request processed in 211us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216860.701563:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1782216860.701640:0:7470:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:7470:1868789733931520:0@lo:501: 00000100:00100000:2.0:1782216860.701667:0:7470:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:7470:1868789733931648:0@lo:503: 00000100:00100000:2.0:1782216860.701704:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216860.701718:0:7470:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6485f9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782216860.701733:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733931648 00000100:00100000:2.0:1782216860.701736:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733931648 00000100:00100000:2.0:1782216860.701767:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1782216860.701774:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e68044cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+13:7470:x1868789733931648:12345-0@lo:503: 00000100:00100000:2.0:1782216860.702084:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e68044cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+13:7470:x1868789733931648:12345-0@lo:503: Request processed in 309us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216860.702090:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1782216860.702128:0:7470:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:7470:1868789733931648:0@lo:503: 00000040:00080000:2.0:1782216860.702508:0:7470:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782216860.702562:0:7470:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:7470:1868789733931776:0@lo:502: 00000100:00100000:2.0:1782216860.702596:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216860.702616:0:7470:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6485f9b40 going to sleep for 11 seconds 00010000:00010000:0.0:1782216860.702684:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782216860.702691:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3a00/0xf210a9075089ea0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf210a9075089ea14 expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.702699:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67a2d3a00 already unused, calling callback (ffffffffc1d2fc20) 10000000:00010000:0.0:1782216860.702703:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3a00/0xf210a9075089ea0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf210a9075089ea14 expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.702711:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3a00/0xf210a9075089ea0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xf210a9075089ea14 expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782216860.702717:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3a00/0xf210a9075089ea0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xf210a9075089ea14 expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216860.702723:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782216860.702742:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3a00/0xf210a9075089ea0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf210a9075089ea14 expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.702749:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782216860.702773:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3a00/0xf210a9075089ea0d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf210a9075089ea14 expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.702780:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3a00/0xf210a9075089ea0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf210a9075089ea14 expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.702792:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216860.702793:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216860.702801:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216860.702808:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782216860.702818:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:526a4802-b871-4bcf-870f-067f11655366:3301:1868789733931904:0@lo:103: 00000100:00100000:0.0:1782216860.702845:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216860.702937:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733931904 00000100:00100000:0.0:1782216860.702941:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733931904 00000100:00100000:0.0:1782216860.702974:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782216860.702982:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:526a4802-b871-4bcf-870f-067f11655366+13:3301:x1868789733931904:12345-0@lo:103: 00010000:00010000:0.0:1782216860.702991:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782216860.703003:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e640030200/0xf210a9075089ea14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf210a9075089ea0d expref: 13 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.703013:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782216860.703039:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:526a4802-b871-4bcf-870f-067f11655366+12:3301:x1868789733931904:12345-0@lo:103: Request processed in 58us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216860.703045:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782216860.703071:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:526a4802-b871-4bcf-870f-067f11655366:3301:1868789733931904:0@lo:103: 00000100:00100000:1.0:1782216860.703249:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733931776 00000100:00100000:1.0:1782216860.703253:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733931776 00000100:00100000:1.0:1782216860.703285:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782216860.703293:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e68044c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+12:7470:x1868789733931776:12345-0@lo:502: 00000100:00100000:1.0:1782216860.703449:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e68044c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+12:7470:x1868789733931776:12345-0@lo:502: Request processed in 156us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216860.703456:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1782216860.703549:0:7470:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:7470:1868789733931776:0@lo:502: 00000040:00080000:2.0:1782216860.703789:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1782216860.704060:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1782216860.704103:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1782216860.704149:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1782216860.704186:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1782216860.704221:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1782216860.704248:0:7470:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:7470:1868789733932032:0@lo:502: 00000100:00100000:2.0:1782216860.704291:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216860.704367:0:7470:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6485f9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782216860.704595:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733932032 00000100:00100000:1.0:1782216860.704601:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733932032 00000100:00100000:1.0:1782216860.704642:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1782216860.704650:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+12:7470:x1868789733932032:12345-0@lo:502: 00000100:00100000:1.0:1782216860.707738:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+12:7470:x1868789733932032:12345-0@lo:502: Request processed in 3077us (3435us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216860.707753:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1782216860.709780:0:7470:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:7470:1868789733932032:0@lo:502: 00000040:00080000:0.0:1782216860.712594:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1782216860.712616:0:7470:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1782216860.715014:0:7479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1782216860.715026:0:7479:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1782216860.715032:0:7479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782216860.715034:0:7479:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1782216860.715040:0:7479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782216860.715055:0:7479:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff88e6577e99c0) 00000020:00000080:0.0:1782216860.715075:0:7479:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1782216860.715080:0:7479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1782216860.715134:0:7479:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88e64853e800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1782216860.715141:0:7479:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1782216860.715147:0:7479:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf210a9075089ea30 00010000:00010000:2.0:1782216860.724771:0:7479:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1782216860.726339:0:7479:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1782216860.731031:0:7479:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1782216860.731303:0:7479:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1782216860.739638:0:7479:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1782216860.740327:0:7479:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1782216860.741740:0:7479:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1782216860.741751:0:7479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782216860.741757:0:7479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782216860.741759:0:7479:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1782216860.741762:0:7479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782216860.741766:0:7479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782216860.741768:0:7479:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1782216860.741771:0:7479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1782216860.741773:0:7479:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1782216860.741817:0:7479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782216860.741821:0:7479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782216860.741823:0:7479:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1782216860.741827:0:7479:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1782216860.744063:0:7470:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1782216860.744101:0:7470:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1782216860.744124:0:7470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3000/0xf210a9075089ea1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ea22 expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216860.744137:0:7470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3000/0xf210a9075089ea1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ea22 expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782216860.744145:0:7470:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff88e64853e800 from 1 10000000:01000000:3.0:1782216860.744147:0:7470:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782216860.744186:0:7470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e653160e00/0xf210a9075089ea37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216860.744194:0:7470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e653160e00/0xf210a9075089ea37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216860.744204:0:7470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e653160e00/0xf210a9075089ea37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216860.744239:0:7470:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:7470:1868789733932160:0@lo:101: 00000100:00100000:3.0:1782216860.744301:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216860.744337:0:7470:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64902e480 going to sleep for 11 seconds 00000100:00100000:1.0:1782216860.744424:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733932160 00000100:00100000:1.0:1782216860.744450:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733932160 00000100:00100000:1.0:1782216860.744496:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1782216860.744505:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+12:7470:x1868789733932160:12345-0@lo:101: 00010000:00010000:1.0:1782216860.744518:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782216860.744529:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e641493000/0xf210a9075089ea3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089ea37 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216860.744552:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e641493000/0xf210a9075089ea3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089ea37 expref: 13 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216860.744561:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e641493000/0xf210a9075089ea3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089ea37 expref: 13 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216860.744570:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e641493000, rc 0) 00000100:00100000:1.0:1782216860.744619:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+13:7470:x1868789733932160:12345-0@lo:101: Request processed in 115us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216860.744626:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1782216860.744743:0:7470:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:7470:1868789733932160:0@lo:101: 00010000:00010000:3.0:1782216860.744757:0:7470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e653160e00/0xf210a9075089ea37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ea3e expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216860.744765:0:7470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e653160e00/0xf210a9075089ea37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089ea3e expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216860.747066:0:7470:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:7470:1868789733932288:0@lo:501: 00000100:00100000:3.0:1782216860.747132:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216860.747173:0:7470:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64902e480 going to sleep for 11 seconds 00000100:00100000:0.0:1782216860.748296:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733932288 00000100:00100000:0.0:1782216860.748305:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733932288 00000100:00100000:0.0:1782216860.748361:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1782216860.748370:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+13:7470:x1868789733932288:12345-0@lo:501: 00000100:00100000:0.0:1782216860.748643:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+13:7470:x1868789733932288:12345-0@lo:501: Request processed in 273us (1509us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216860.748650:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1782216860.748796:0:7470:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:7470:1868789733932288:0@lo:501: 00000100:00100000:3.0:1782216860.748836:0:7470:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:7470:1868789733932416:0@lo:503: 00000100:00100000:3.0:1782216860.749072:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216860.749103:0:7470:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64902e480 going to sleep for 11 seconds 00000100:00100000:2.0:1782216860.749171:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733932416 00000100:00100000:2.0:1782216860.749176:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733932416 00000100:00100000:2.0:1782216860.749210:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1782216860.749217:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+13:7470:x1868789733932416:12345-0@lo:503: 00000100:00100000:2.0:1782216860.749531:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+13:7470:x1868789733932416:12345-0@lo:503: Request processed in 313us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216860.749537:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1782216860.750395:0:7470:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:7470:1868789733932416:0@lo:503: 00000040:00080000:3.0:1782216860.750708:0:7470:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782216860.750775:0:7470:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:7470:1868789733932544:0@lo:502: 00000100:00100000:3.0:1782216860.750830:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216860.752091:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733932544 00000100:00100000:2.0:1782216860.752101:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733932544 00000100:00100000:2.0:1782216860.752148:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1782216860.752157:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+13:7470:x1868789733932544:12345-0@lo:502: 00000100:00100000:2.0:1782216860.752398:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+13:7470:x1868789733932544:12345-0@lo:502: Request processed in 241us (1567us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216860.752405:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1782216860.752516:0:7470:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64902e480 going to sleep for 11 seconds 00000100:00100000:3.0:1782216860.752538:0:7470:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:7470:1868789733932544:0@lo:502: 00000040:00080000:3.0:1782216860.752788:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1782216860.752866:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1782216860.754378:0:7470:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:7470:1868789733932672:0@lo:502: 00000100:00100000:3.0:1782216860.754465:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216860.754507:0:7470:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64902e480 going to sleep for 11 seconds 00000100:00100000:2.0:1782216860.755177:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733932672 00000100:00100000:2.0:1782216860.755186:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733932672 00000100:00100000:2.0:1782216860.755245:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1782216860.755254:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+13:7470:x1868789733932672:12345-0@lo:502: 00000100:00100000:2.0:1782216860.755469:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+13:7470:x1868789733932672:12345-0@lo:502: Request processed in 215us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216860.755478:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1782216860.755592:0:7470:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:7470:1868789733932672:0@lo:502: 00000040:00080000:3.0:1782216860.755732:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1782216860.755745:0:7470:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1782216860.760224:0:7483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782216860.760235:0:7483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216860.760237:0:7483:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1782216860.760243:0:7483:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff88e64853e800 00000020:00000080:1.0:1782216860.760246:0:7483:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782216860.760263:0:7483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782216860.760265:0:7483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216860.760267:0:7483:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1782216860.760269:0:7483:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1782216860.760390:0:7470:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1782216860.760420:0:7470:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782216860.760452:0:7470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e653160e00/0xf210a9075089ea37 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ea3e expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.760465:0:7470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e653160e00/0xf210a9075089ea37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ea3e expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216860.760501:0:7470:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1782216860.760504:0:7470:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88e64853e800 10000000:01000000:2.0:1782216860.760506:0:7470:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88e64853e800 10000000:01000000:2.0:1782216860.760516:0:7470:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782216860.760522:0:7470:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff88e64853e800 from 1 10000000:01000000:2.0:1782216860.760524:0:7470:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782216860.760559:0:7470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2600/0xf210a9075089ea45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.760566:0:7470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2600/0xf210a9075089ea45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.760577:0:7470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2600/0xf210a9075089ea45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216860.760596:0:7470:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652480000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:7470:1868789733932800:0@lo:101: 00000100:00100000:2.0:1782216860.760653:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216860.760682:0:7470:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6485f9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782216860.760701:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733932800 00000100:00100000:2.0:1782216860.760706:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733932800 00000100:00100000:2.0:1782216860.760739:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1782216860.760746:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+13:7470:x1868789733932800:12345-0@lo:101: 00010000:00010000:2.0:1782216860.760758:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216860.760768:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e67a2d3600/0xf210a9075089ea4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089ea45 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.760788:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e67a2d3600/0xf210a9075089ea4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089ea45 expref: 14 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.760797:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e67a2d3600/0xf210a9075089ea4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089ea45 expref: 14 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.760807:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67a2d3600, rc 0) 00000100:00100000:2.0:1782216860.760841:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+14:7470:x1868789733932800:12345-0@lo:101: Request processed in 95us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216860.760848:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1782216860.760911:0:7470:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652480000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:7470:1868789733932800:0@lo:101: 00010000:00010000:2.0:1782216860.760923:0:7470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2600/0xf210a9075089ea45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ea4c expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.761134:0:7470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2600/0xf210a9075089ea45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089ea4c expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216860.761209:0:7470:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652480000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:7470:1868789733932928:0@lo:501: 00000100:00100000:2.0:1782216860.761230:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216860.762589:0:7470:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6485f9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782216860.764822:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733932928 00000100:00100000:3.0:1782216860.764835:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733932928 00000100:00100000:3.0:1782216860.764912:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1782216860.764921:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+14:7470:x1868789733932928:12345-0@lo:501: 00000100:00100000:3.0:1782216860.765229:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+14:7470:x1868789733932928:12345-0@lo:501: Request processed in 308us (3995us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216860.765246:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1782216860.766118:0:7470:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652480000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:7470:1868789733932928:0@lo:501: 00000100:00100000:3.0:1782216860.766167:0:7470:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:7470:1868789733933056:0@lo:503: 00000100:00100000:3.0:1782216860.766219:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216860.766341:0:7470:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64902e180 going to sleep for 11 seconds 00000100:00100000:0.0:1782216860.766465:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733933056 00000100:00100000:0.0:1782216860.766471:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733933056 00000100:00100000:0.0:1782216860.766546:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1782216860.766555:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+14:7470:x1868789733933056:12345-0@lo:503: 00000100:00100000:0.0:1782216860.766770:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+14:7470:x1868789733933056:12345-0@lo:503: Request processed in 215us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216860.766777:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1782216860.767082:0:7470:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:7470:1868789733933056:0@lo:503: 00000040:00080000:2.0:1782216860.767422:0:7470:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782216860.767497:0:7470:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652481180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:7470:1868789733933184:0@lo:502: 00000100:00100000:2.0:1782216860.767541:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216860.767612:0:7470:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6485f9300 going to sleep for 11 seconds 00000100:00100000:0.0:1782216860.767755:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733933184 00000100:00100000:0.0:1782216860.767761:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733933184 00000100:00100000:0.0:1782216860.767798:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1782216860.767806:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+14:7470:x1868789733933184:12345-0@lo:502: 00000100:00100000:0.0:1782216860.768136:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+14:7470:x1868789733933184:12345-0@lo:502: Request processed in 329us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216860.768143:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1782216860.768249:0:7470:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652481180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:7470:1868789733933184:0@lo:502: 00000040:00080000:2.0:1782216860.768520:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1782216860.768569:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1782216860.768765:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1782216860.768812:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1782216860.768845:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1782216860.769029:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1782216860.769070:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1782216860.769118:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1782216860.769167:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1782216860.769216:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1782216860.769318:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1782216860.769365:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1782216860.769403:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1782216860.769450:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1782216860.769494:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1782216860.769522:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1782216860.769550:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1782216860.769818:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1782216860.769858:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1782216860.770050:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1782216860.770106:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1782216860.770144:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1782216860.770179:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1782216860.770382:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1782216860.770425:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1782216860.770474:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1782216860.770522:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1782216860.770557:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1782216860.770670:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1782216860.770737:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1782216860.770774:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1782216860.770803:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1782216860.770831:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1782216860.770872:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1782216860.771138:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1782216860.771188:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1782216860.771221:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1782216860.771337:0:7470:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652481180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:7470:1868789733933312:0@lo:502: 00000100:00100000:2.0:1782216860.771415:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216860.773823:0:7470:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6485f9300 going to sleep for 11 seconds 00000100:00100000:3.0:1782216860.777068:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733933312 00000100:00100000:3.0:1782216860.777083:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733933312 00000100:00100000:3.0:1782216860.777187:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1782216860.777197:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+14:7470:x1868789733933312:12345-0@lo:502: 00000100:00100000:3.0:1782216860.777501:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+14:7470:x1868789733933312:12345-0@lo:502: Request processed in 305us (6085us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216860.777509:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1782216860.777597:0:7470:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652481180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:7470:1868789733933312:0@lo:502: 00000040:00080000:1.0:1782216860.777705:0:7470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1782216860.777721:0:7470:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1782216860.779497:0:7484:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1782216860.779528:0:7484:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff88e67a630000) 00000020:00000080:3.0:1782216860.779554:0:7484:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1782216860.779754:0:7484:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88e64853e800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1782216860.779758:0:7484:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88e64853e800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1782216860.779761:0:7484:0:(obd_mount.c:701:lustre_put_lsi()) put ffff88e64853e800 3 00010000:00080000:3.0:1782216860.779802:0:7484:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88e679feb000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.119@tcp at head 00010000:00010000:3.0:1782216860.781394:0:7484:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1782216860.781504:0:7484:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1782216860.781541:0:7484:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1782216860.781554:0:7484:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf210a9075089ea5a 00000100:00080000:3.0:1782216860.781565:0:7484:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782216860.781571:0:7484:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88e679feb000 using connection 192.168.203.119@tcp/0@lo 00000100:00100000:3.0:1782216860.781610:0:7484:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88e67a1f1f80 x1868789733933440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782216860.781630:0:7484:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1782216860.782603:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733933696:0@lo:400: 00000100:00100000:0.0:1782216860.782674:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216860.782710:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782216860.782716:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868789733933568:0@lo:400: 00000100:00100000:0.0:1782216860.782742:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216860.782768:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1868789733933824:0@lo:400: 00000100:00100000:0.0:1782216860.782802:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216860.782840:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733933696 00000100:00100000:0.0:1782216860.782848:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733933696 00000100:00100000:0.0:1782216860.782909:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782216860.782919:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733933696:12345-0@lo:400: 00000100:00100000:0.0:1782216860.782990:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733933696:12345-0@lo:400: Request processed in 73us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216860.782998:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782216860.783023:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733933568 00000100:00100000:0.0:1782216860.783027:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733933568 00000100:00100000:0.0:1782216860.783049:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733933824 00000100:00100000:0.0:1782216860.783052:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733933824 00000100:00100000:0.0:1782216860.783071:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782216860.783077:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868789733933568:12345-0@lo:400: 00000100:00100000:0.0:1782216860.783107:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868789733933568:12345-0@lo:400: Request processed in 29us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216860.783113:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782216860.783140:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782216860.783146:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1868789733933824:12345-0@lo:400: 00000100:00100000:0.0:1782216860.783177:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1868789733933824:12345-0@lo:400: Request processed in 32us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216860.783183:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1782216860.783339:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88e67a1e4e00 x1868789733933824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216860.783354:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1868789733933824:0@lo:400: 00010000:00080000:0.0:1782216860.783385:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88e67a1e7800 x1868789733933568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216860.783408:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868789733933568:0@lo:400: 00010000:00080000:0.0:1782216860.783423:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88e67a1e5880 x1868789733933696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216860.783444:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733933696:0@lo:400: 00000100:00100000:2.0:1782216860.783659:0:3300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3300:1868789733933440:0@lo:38: 00000100:00100000:2.0:1782216860.783702:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1782216860.784095:0:7484:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:0.0:1782216860.784289:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733933440 00000100:00100000:0.0:1782216860.784295:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733933440 00000100:00100000:0.0:1782216860.784330:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782216860.784335:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3300:x1868789733933440:12345-0@lo:38: 00010000:00080000:0.0:1782216860.784357:0:5785:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:0.0:1782216860.784386:0:5785:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf210a9075089ea61 00000004:00100000:0.0:1782216860.784399:0:5785:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1782216860.784443:0:5785:0:(import.c:65:import_set_state_nolock()) ffff88e67f2ad800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782216860.784492:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1868789733933440:12345-0@lo:38: Request processed in 154us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216860.784498:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1782216860.784531:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88e67a1f1f80 x1868789733933440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782216870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216860.784541:0:3300:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782216860.784548:0:3300:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1782216860.784554:0:3300:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1782216860.784558:0:3300:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1782216860.784561:0:3300:0:(import.c:65:import_set_state_nolock()) ffff88e679feb000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1782216860.784567:0:3300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3300:1868789733933440:0@lo:38: 00000020:01000000:1.0:1782216860.784908:0:7470:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1782216860.785124:0:7470:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782216860.785149:0:7470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2600/0xf210a9075089ea45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ea4c expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216860.785160:0:7470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2600/0xf210a9075089ea45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ea4c expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1782216860.785209:0:7470:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1782216860.785211:0:7470:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1782216860.785212:0:7470:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782216860.785214:0:7470:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782216860.785215:0:7470:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782216860.785216:0:7470:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782216860.785217:0:7470:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782216860.785219:0:7470:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782216860.785220:0:7470:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782216860.785222:0:7470:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782216860.785223:0:7470:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782216860.785227:0:7470:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1782216860.785350:0:7470:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1782216860.785352:0:7470:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1782216860.785353:0:7470:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782216860.785355:0:7470:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782216860.785356:0:7470:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782216860.785357:0:7470:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782216860.785358:0:7470:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782216860.785360:0:7470:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782216860.785361:0:7470:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782216860.785362:0:7470:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782216860.785363:0:7470:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782216860.785382:0:7470:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1782216860.785397:0:7470:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b94700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:7470:1868789733933952:0@lo:253: 00000100:00100000:1.0:1782216860.785455:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216860.785491:0:7470:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e650894c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782216860.786030:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733933952 00000100:00100000:3.0:1782216860.786038:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733933952 00000100:00100000:3.0:1782216860.786077:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1782216860.786085:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+14:7470:x1868789733933952:12345-0@lo:253: 20000000:01000000:3.0:1782216860.786112:0:5776:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1782216860.786125:0:5776:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1782216860.795547:0:7485:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652480380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7485:1868789733934080:0@lo:901: 00000100:00100000:2.0:1782216860.795616:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216860.795655:0:7485:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6485f9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782216860.795739:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733934080 00000100:00100000:1.0:1782216860.795747:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733934080 00000100:00100000:1.0:1782216860.795821:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782216860.795830:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7485:x1868789733934080:12345-0@lo:901: 00000100:00080000:2.0:1782216860.796385:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782216860.796418:0:7485:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88e652480380 x1868789733934080/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1782216876 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216860.796445:0:7485:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652480380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7485:1868789733934080:0@lo:901: 00000100:00100000:1.0:1782216860.796565:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7485:x1868789733934080:12345-0@lo:901: Request processed in 404us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216860.796572:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 20000000:01000000:3.0:1782216860.839443:0:5776:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1782216860.839461:0:5776:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1782216860.840719:0:5799:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1782216860.840727:0:5799:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1782216860.840749:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88e641493c00/0xf210a9075089ea68 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216860.840768:0:5799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88e682170400/0xf210a9075089e9f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089e9ea expref: 14 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216860.840777:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88e641493c00/0xf210a9075089ea68 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216860.840818:0:5799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88e682170400/0xf210a9075089e9f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf210a9075089e9ea expref: 14 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216860.840832:0:5799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88e682170400/0xf210a9075089e9f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf210a9075089e9ea expref: 14 pid: 5775 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216860.840847:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b95880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5799:1868789733934208:0@lo:104: 00000100:00100000:1.0:1782216860.840962:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216860.841011:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e651654540 going to sleep for 11 seconds 00000100:00100000:0.0:1782216860.841149:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733934208 00000100:00100000:0.0:1782216860.841163:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733934208 00000100:00100000:0.0:1782216860.841211:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782216860.841220:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:526a4802-b871-4bcf-870f-067f11655366+3:5799:x1868789733934208:12345-0@lo:104: 00010000:00010000:0.0:1782216860.841234:0:6593:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.119@tcp lock: ffff88e653161200/0xf210a9075089e9ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089e9f1 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.841284:0:6593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782216860.841290:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:526a4802-b871-4bcf-870f-067f11655366+3:5799:x1868789733934208:12345-0@lo:104: Request processed in 72us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216860.841298:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1782216860.841319:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782216860.841325:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e653161200/0xf210a9075089e9ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089e9f1 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.841332:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e653161200 already unused, calling callback (ffffffffc1d2fc20) 10000000:00010000:0.0:1782216860.841337:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e653161200/0xf210a9075089e9ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf210a9075089e9f1 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.841345:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e653161200/0xf210a9075089e9ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf210a9075089e9f1 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782216860.841353:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e653161200/0xf210a9075089e9ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf210a9075089e9f1 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216860.841359:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1782216860.841389:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: ffff88e653161200/0xf210a9075089e9ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e9f1 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.841396:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782216860.841412:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e653161200/0xf210a9075089e9ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e9f1 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.841435:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e653161200/0xf210a9075089e9ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e9f1 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.841450:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216860.841452:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216860.841454:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216860.841468:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:526a4802-b871-4bcf-870f-067f11655366:3302:1868789733934336:0@lo:103: 00000100:00100000:0.0:1782216860.841496:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216860.841546:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733934336 00000100:00100000:0.0:1782216860.841550:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733934336 00010000:00010000:0.0:1782216860.841576:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88e682170400/0xf210a9075089e9f1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089e9ea expref: 15 pid: 5775 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216860.841596:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782216860.841603:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:526a4802-b871-4bcf-870f-067f11655366+15:3302:x1868789733934336:12345-0@lo:103: 00010000:00010000:0.0:1782216860.841614:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782216860.841619:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88e682170400/0xf210a9075089e9f1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089e9ea expref: 15 pid: 5775 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.841629:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88e682170400/0xf210a9075089e9f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf210a9075089e9ea expref: 15 pid: 5775 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.841643:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88e641493c00/0xf210a9075089ea68 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.841650:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e641493c00/0xf210a9075089ea68 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782216860.841662:0:5769:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001597180s 00010000:00010000:0.0:1782216860.841672:0:5769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88e641493c00/0xf210a9075089ea68 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.841678:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88e641493c00/0xf210a9075089ea68 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.841684:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88e641493c00/0xf210a9075089ea68 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.841690:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88e641493c00/0xf210a9075089ea68 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.841694:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e641493c00 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:0.0:1782216860.841698:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88e641493c00/0xf210a9075089ea68 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.841704:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88e641493c00/0xf210a9075089ea68 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.841711:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88e641493c00/0xf210a9075089ea68 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.841720:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782216860.841749:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:526a4802-b871-4bcf-870f-067f11655366+15:3302:x1868789733934336:12345-0@lo:103: Request processed in 146us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216860.841755:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782216860.841789:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:526a4802-b871-4bcf-870f-067f11655366:3302:1868789733934336:0@lo:103: 00010000:00010000:1.0:1782216860.842127:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e682170400/0xf210a9075089e9f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf210a9075089e9ea expref: 14 pid: 5775 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216860.842138:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b95880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5799:1868789733934208:0@lo:104: 00010000:00010000:1.0:1782216860.842150:0:5799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88e641493c00/0xf210a9075089ea68 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216860.842167:0:5799:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88e641493c00/0xf210a9075089ea68 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216860.842172:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88e641493c00/0xf210a9075089ea68 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216860.842178:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e641493c00/0xf210a9075089ea68 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216860.849917:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+13:7470:x1868789733933952:12345-0@lo:253: Request processed in 63822us (64451us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216860.849939:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1782216860.853799:0:7470:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b94700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:526a4802-b871-4bcf-870f-067f11655366:7470:1868789733933952:0@lo:253: 10000000:01000000:0.0:1782216860.853821:0:7470:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1782216860.853824:0:7470:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782216860.853841:0:7470:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782216860.853842:0:7470:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782216860.853843:0:7470:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782216860.853844:0:7470:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782216860.853846:0:7470:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782216860.853847:0:7470:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782216860.853849:0:7470:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782216860.853850:0:7470:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782216860.853851:0:7470:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782216860.853853:0:7470:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1782216860.853867:0:7470:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1782216860.859306:0:7470:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1782216860.859500:0:7470:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1782216860.859792:0:7470:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1782216860.860145:0:7470:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1782216860.860365:0:7470:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1782216860.860660:0:7470:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1782216860.861822:0:7470:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1782216861.101212:0:7470:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1782216861.101220:0:7470:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1782216861.101261:0:7470:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1782216861.101318:0:7470:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.119@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1782216861.101333:0:7470:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1782216861.101360:0:7470:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1782216861.274977:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216862.292686:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216863.321795:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216864.349411:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216864.724041:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782216864.724066:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733934464:0@lo:13: 00000100:00100000:0.0:1782216864.724128:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216864.724188:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733934464 00000100:00100000:0.0:1782216864.724195:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733934464 00000100:00100000:0.0:1782216864.724246:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782216864.724256:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733934464:12345-0@lo:13: 00002000:00000024:0.0:1782216864.724289:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782216864.724469:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733934464:12345-0@lo:13: Request processed in 206us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216864.724477:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1782216864.724553:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67a1e5880 x1868789733934464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216880 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216864.724571:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733934464:0@lo:13: 00000100:00080000:2.0:1782216864.724810:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782216865.368937:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216866.272123:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733934592:0@lo:400: 00000100:00100000:3.0:1782216866.272201:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216866.273838:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733934592 00000100:00100000:1.0:1782216866.273850:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733934592 00000100:00100000:1.0:1782216866.274332:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1782216866.274345:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+13:3304:x1868789733934592:12345-0@lo:400: 00000100:00100000:1.0:1782216866.274430:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+13:3304:x1868789733934592:12345-0@lo:400: Request processed in 88us (2229us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216866.274438:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1782216866.274488:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733934848:0@lo:400: 00000100:00100000:1.0:1782216866.274520:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216866.274596:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733934848 00000100:00100000:0.0:1782216866.274601:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733934848 00000100:00100000:0.0:1782216866.274641:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782216866.274649:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733934848:12345-0@lo:400: 00000100:00100000:0.0:1782216866.274900:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733934848:12345-0@lo:400: Request processed in 252us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216866.274907:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782216866.275462:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789733934720:0@lo:400: 00000100:00100000:1.0:1782216866.275501:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216866.275811:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1868789733934976:0@lo:400: 00000100:00100000:0.0:1782216866.275840:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216866.275864:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733934720 00000100:00100000:0.0:1782216866.275869:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733934720 00000100:00100000:0.0:1782216866.275929:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733934976 00000100:00100000:0.0:1782216866.275933:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733934976 00000100:00100000:0.0:1782216866.275955:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782216866.275961:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789733934720:12345-0@lo:400: 00000100:00100000:0.0:1782216866.275996:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789733934720:12345-0@lo:400: Request processed in 34us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216866.276002:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782216866.276015:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782216866.276021:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868789733934976:12345-0@lo:400: 00000100:00100000:0.0:1782216866.276050:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868789733934976:12345-0@lo:400: Request processed in 30us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216866.276056:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782216866.276250:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733934592:0@lo:400: 00000100:00100000:3.0:1782216866.276259:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1868789733935104:0@lo:400: 00000100:00100000:3.0:1782216866.276304:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216866.276331:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733935104 00000100:00100000:3.0:1782216866.276335:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733935104 00000100:00100000:3.0:1782216866.276361:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782216866.276367:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a800380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868789733935104:12345-0@lo:400: 00000100:00100000:3.0:1782216866.276411:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a800380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868789733935104:12345-0@lo:400: Request processed in 44us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216866.276416:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1782216866.277824:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67a1f1f80 x1868789733934976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216866.277838:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1868789733934976:0@lo:400: 00010000:00080000:0.0:1782216866.277911:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67a1f2a00 x1868789733934848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216866.277930:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733934848:0@lo:400: 00010000:00080000:0.0:1782216866.277969:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67a1f0000 x1868789733935104/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216866.277977:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1868789733935104:0@lo:400: 00000100:00080000:2.0:1782216866.278196:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782216866.278202:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782216866.281301:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67a1f1180 x1868789733934720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216866.281318:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789733934720:0@lo:400: 00010000:00010000:3.0:1782216866.388060:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782216866.772493:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782216866.772500:0:5780:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff88e673f4d000 from 30 10000000:01000000:2.0:1782216866.772505:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782216866.772548:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2200/0xf210a9075089ea6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216866.772560:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2200/0xf210a9075089ea6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216866.772570:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2200/0xf210a9075089ea6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216866.772591:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652480380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733935232:0@lo:101: 00000100:00100000:2.0:1782216866.772654:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216866.772707:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6504596c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782216866.773141:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733935232 00000100:00100000:0.0:1782216866.773149:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733935232 00000100:00100000:0.0:1782216866.773204:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1782216866.773212:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+13:5780:x1868789733935232:12345-0@lo:101: 00010000:00010000:0.0:1782216866.773226:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216866.773238:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e640031400/0xf210a9075089ea76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089ea6f expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216866.773261:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e640031400/0xf210a9075089ea76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089ea6f expref: 14 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216866.773271:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e640031400/0xf210a9075089ea76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089ea6f expref: 14 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216866.773280:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e640031400, rc 0) 00000100:00100000:0.0:1782216866.773318:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+14:5780:x1868789733935232:12345-0@lo:101: Request processed in 107us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216866.773324:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1782216866.773511:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652480380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733935232:0@lo:101: 00010000:00010000:2.0:1782216866.773525:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2200/0xf210a9075089ea6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ea76 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216866.773541:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2200/0xf210a9075089ea6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089ea76 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216866.773597:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652480380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733935360:0@lo:501: 00000100:00100000:2.0:1782216866.773623:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216866.773651:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6504596c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782216866.773695:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733935360 00000100:00100000:0.0:1782216866.773699:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733935360 00000100:00100000:0.0:1782216866.773721:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1782216866.773727:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+14:5780:x1868789733935360:12345-0@lo:501: 00000100:00100000:0.0:1782216866.774074:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+14:5780:x1868789733935360:12345-0@lo:501: Request processed in 346us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216866.774089:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1782216866.780066:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652480380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733935360:0@lo:501: 00000100:00100000:2.0:1782216866.780126:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652480380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733935488:0@lo:503: 00000100:00100000:2.0:1782216866.780197:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216866.780231:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6504596c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782216866.780250:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733935488 00000100:00100000:2.0:1782216866.780255:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733935488 00000100:00100000:2.0:1782216866.780297:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1782216866.780306:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+14:5780:x1868789733935488:12345-0@lo:503: 00000100:00100000:2.0:1782216866.782686:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+14:5780:x1868789733935488:12345-0@lo:503: Request processed in 2372us (2480us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216866.782701:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1782216866.782850:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652480380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733935488:0@lo:503: 00000100:00100000:2.0:1782216866.784498:0:7772:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652481f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:7772:1868789733935616:0@lo:502: 00000100:00100000:2.0:1782216866.784572:0:7772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216866.784611:0:7772:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e650459cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782216866.784851:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733935616 00000100:00100000:0.0:1782216866.784858:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733935616 00000100:00100000:0.0:1782216866.785007:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1782216866.785018:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+14:7772:x1868789733935616:12345-0@lo:502: 00000100:00100000:0.0:1782216866.785310:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+14:7772:x1868789733935616:12345-0@lo:502: Request processed in 294us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216866.785317:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1782216866.786621:0:7772:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652481f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:7772:1868789733935616:0@lo:502: 00000100:00100000:2.0:1782216866.786688:0:7772:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652481f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:7772:1868789733935744:0@lo:502: 00000100:00100000:2.0:1782216866.786740:0:7772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216866.786778:0:7772:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e650459cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782216866.786840:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733935744 00000100:00100000:0.0:1782216866.786845:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733935744 00000100:00100000:0.0:1782216866.786906:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1782216866.786914:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+14:7772:x1868789733935744:12345-0@lo:502: 00000100:00100000:0.0:1782216866.787093:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+14:7772:x1868789733935744:12345-0@lo:502: Request processed in 178us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216866.787100:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1782216866.787221:0:7772:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652481f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:7772:1868789733935744:0@lo:502: 00000040:00080000:2.0:1782216866.787242:0:7772:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1782216866.787471:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1782216866.787500:0:5780:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782216866.787511:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2200/0xf210a9075089ea6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ea76 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216866.787521:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2200/0xf210a9075089ea6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ea76 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216866.787529:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1782216866.787532:0:5780:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1782216866.787535:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1782216866.787561:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e640031e00/0xf210a9075089ea7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216866.787579:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e640031e00/0xf210a9075089ea7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216866.787588:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e640031e00/0xf210a9075089ea7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216866.787601:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733935872:0@lo:101: 00000100:00100000:0.0:1782216866.787630:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216866.787662:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6485f9240 going to sleep for 11 seconds 00000100:00100000:2.0:1782216866.787708:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733935872 00000100:00100000:2.0:1782216866.787713:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733935872 00000100:00100000:2.0:1782216866.787745:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1782216866.787752:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+14:5780:x1868789733935872:12345-0@lo:101: 00010000:00010000:2.0:1782216866.787761:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216866.787773:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e67a2d3400/0xf210a9075089ea84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089ea7d expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216866.787794:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e67a2d3400/0xf210a9075089ea84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089ea7d expref: 15 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216866.787803:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e67a2d3400/0xf210a9075089ea84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089ea7d expref: 15 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216866.787812:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67a2d3400, rc 0) 00000100:00100000:2.0:1782216866.787842:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+15:5780:x1868789733935872:12345-0@lo:101: Request processed in 90us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216866.787847:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1782216866.788860:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733935872:0@lo:101: 00010000:00010000:0.0:1782216866.788901:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e640031e00/0xf210a9075089ea7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ea84 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216866.788911:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e640031e00/0xf210a9075089ea7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089ea84 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216866.788965:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733936000:0@lo:501: 00000100:00100000:0.0:1782216866.788997:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216866.789023:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6485f9240 going to sleep for 11 seconds 00000100:00100000:2.0:1782216866.789074:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733936000 00000100:00100000:2.0:1782216866.789079:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733936000 00000100:00100000:2.0:1782216866.789113:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1782216866.789121:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+15:5780:x1868789733936000:12345-0@lo:501: 00000100:00100000:2.0:1782216866.789326:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+15:5780:x1868789733936000:12345-0@lo:501: Request processed in 204us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216866.789333:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1782216866.790513:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733936000:0@lo:501: 00000100:00100000:0.0:1782216866.790551:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733936128:0@lo:503: 00000100:00100000:0.0:1782216866.790595:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216866.790620:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6485f9240 going to sleep for 11 seconds 00000100:00100000:0.0:1782216866.790634:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733936128 00000100:00100000:0.0:1782216866.790638:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733936128 00000100:00100000:0.0:1782216866.790666:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1782216866.790677:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+15:5780:x1868789733936128:12345-0@lo:503: 00000100:00100000:0.0:1782216866.790984:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+15:5780:x1868789733936128:12345-0@lo:503: Request processed in 306us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216866.790991:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1782216866.791037:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733936128:0@lo:503: 00000100:00100000:0.0:1782216866.791199:0:7773:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:7773:1868789733936256:0@lo:502: 00000100:00100000:0.0:1782216866.791232:0:7773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216866.791250:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733936256 00000100:00100000:0.0:1782216866.791253:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733936256 00000100:00100000:0.0:1782216866.791274:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1782216866.791281:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+15:7773:x1868789733936256:12345-0@lo:502: 00000100:00100000:0.0:1782216866.792123:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+15:7773:x1868789733936256:12345-0@lo:502: Request processed in 839us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216866.792133:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1782216866.792169:0:7773:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6485f9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782216866.792185:0:7773:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:7773:1868789733936256:0@lo:502: 00000020:01000000:0.0:1782216866.792212:0:7773:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782216866.792220:0:7773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782216866.792223:0:7773:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782216866.792227:0:7773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782216866.792228:0:7773:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1782216866.792247:0:7773:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:7773:1868789733936384:0@lo:502: 00000100:00100000:0.0:1782216866.792282:0:7773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216866.792307:0:7773:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6738e7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782216866.793908:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733936384 00000100:00100000:2.0:1782216866.793926:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733936384 00000100:00100000:2.0:1782216866.793982:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1782216866.793992:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+15:7773:x1868789733936384:12345-0@lo:502: 00000100:00100000:2.0:1782216866.794212:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+15:7773:x1868789733936384:12345-0@lo:502: Request processed in 221us (1928us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216866.794220:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1782216866.794338:0:7773:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:7773:1868789733936384:0@lo:502: 00000020:01000000:1.0:1782216866.794369:0:7773:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782216866.794376:0:7773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216866.794378:0:7773:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1782216866.794394:0:7773:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1782216866.794455:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1782216866.794472:0:5780:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1782216866.794482:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e640031e00/0xf210a9075089ea7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ea84 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216866.794492:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e640031e00/0xf210a9075089ea7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ea84 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782216866.794501:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1782216866.794504:0:5780:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff88e650a2a800 from 30 10000000:01000000:1.0:1782216866.794506:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782216866.794532:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e641493c00/0xf210a9075089ea8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216866.794541:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e641493c00/0xf210a9075089ea8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216866.794556:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e641493c00/0xf210a9075089ea8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216866.794573:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733936512:0@lo:101: 00000100:00100000:1.0:1782216866.794606:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216866.794637:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e650716600 going to sleep for 11 seconds 00000100:00100000:1.0:1782216866.794651:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733936512 00000100:00100000:1.0:1782216866.794654:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733936512 00000100:00100000:1.0:1782216866.794676:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1782216866.794683:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+15:5780:x1868789733936512:12345-0@lo:101: 00010000:00010000:1.0:1782216866.794691:0:5775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782216866.794703:0:5775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e641492a00/0xf210a9075089ea92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089ea8b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216866.794722:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e641492a00/0xf210a9075089ea92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089ea8b expref: 16 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216866.794733:0:5775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e641492a00/0xf210a9075089ea92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089ea8b expref: 16 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216866.794742:0:5775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e641492a00, rc 0) 00000100:00100000:1.0:1782216866.794772:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+16:5780:x1868789733936512:12345-0@lo:101: Request processed in 89us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216866.794779:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1782216866.794815:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733936512:0@lo:101: 00010000:00010000:1.0:1782216866.794827:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e641493c00/0xf210a9075089ea8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ea92 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216866.794844:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e641493c00/0xf210a9075089ea8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089ea92 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216866.794904:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733936640:0@lo:501: 00000100:00100000:1.0:1782216866.794928:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216866.794942:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e650716600 going to sleep for 11 seconds 00000100:00100000:1.0:1782216866.794953:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733936640 00000100:00100000:1.0:1782216866.794956:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733936640 00000100:00100000:1.0:1782216866.794971:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1782216866.794976:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+16:5780:x1868789733936640:12345-0@lo:501: 00000100:00100000:1.0:1782216866.795180:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+16:5780:x1868789733936640:12345-0@lo:501: Request processed in 203us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216866.795187:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1782216866.795216:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733936640:0@lo:501: 00000100:00100000:1.0:1782216866.795239:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733936768:0@lo:503: 00000100:00100000:1.0:1782216866.795272:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216866.795285:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e650716600 going to sleep for 11 seconds 00000100:00100000:1.0:1782216866.795295:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733936768 00000100:00100000:1.0:1782216866.795298:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733936768 00000100:00100000:1.0:1782216866.795314:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1782216866.795319:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+16:5780:x1868789733936768:12345-0@lo:503: 00000100:00100000:1.0:1782216866.795448:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+16:5780:x1868789733936768:12345-0@lo:503: Request processed in 127us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216866.795453:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1782216866.795485:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733936768:0@lo:503: 00000100:00100000:2.0:1782216866.796917:0:7774:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652481f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:7774:1868789733936896:0@lo:502: 00000100:00100000:2.0:1782216866.796980:0:7774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216866.797009:0:7774:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e68058d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782216866.797075:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733936896 00000100:00100000:1.0:1782216866.797080:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733936896 00000100:00100000:1.0:1782216866.797126:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1782216866.797134:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+16:7774:x1868789733936896:12345-0@lo:502: 00000100:00100000:1.0:1782216866.797329:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+16:7774:x1868789733936896:12345-0@lo:502: Request processed in 195us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216866.797337:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1782216866.797609:0:7774:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652481f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:7774:1868789733936896:0@lo:502: 00000100:00100000:2.0:1782216866.797657:0:7774:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652481f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:7774:1868789733937024:0@lo:502: 00000100:00100000:2.0:1782216866.797691:0:7774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216866.797715:0:7774:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e68058d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782216866.797757:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733937024 00000100:00100000:1.0:1782216866.797761:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733937024 00000100:00100000:1.0:1782216866.797791:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1782216866.797798:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+16:7774:x1868789733937024:12345-0@lo:502: 00000100:00100000:1.0:1782216866.797956:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+16:7774:x1868789733937024:12345-0@lo:502: Request processed in 157us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216866.797962:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1782216866.798131:0:7774:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652481f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:7774:1868789733937024:0@lo:502: 00000040:00080000:2.0:1782216866.798150:0:7774:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1782216866.798282:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1782216866.798301:0:5780:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782216866.798311:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e641493c00/0xf210a9075089ea8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ea92 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216866.798320:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e641493c00/0xf210a9075089ea8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ea92 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782216866.798329:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1782216866.798332:0:5780:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff88e650a2a800 from 5 10000000:01000000:1.0:1782216866.798334:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782216866.798359:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e641492800/0xf210a9075089ea99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216866.798367:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e641492800/0xf210a9075089ea99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216866.798455:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e641492800/0xf210a9075089ea99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216866.798471:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733937152:0@lo:101: 00000100:00100000:1.0:1782216866.798500:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216866.798523:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6609e9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782216866.798568:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733937152 00000100:00100000:2.0:1782216866.798573:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733937152 00000100:00100000:2.0:1782216866.798605:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1782216866.798611:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+16:5780:x1868789733937152:12345-0@lo:101: 00010000:00010000:2.0:1782216866.798621:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216866.798633:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e67a2d2e00/0xf210a9075089eaa0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089ea99 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216866.798652:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e67a2d2e00/0xf210a9075089eaa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089ea99 expref: 17 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216866.798661:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e67a2d2e00/0xf210a9075089eaa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089ea99 expref: 17 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216866.798676:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67a2d2e00, rc 0) 00000100:00100000:2.0:1782216866.798719:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+17:5780:x1868789733937152:12345-0@lo:101: Request processed in 108us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216866.798725:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1782216866.798804:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733937152:0@lo:101: 00010000:00010000:0.0:1782216866.798816:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e641492800/0xf210a9075089ea99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089eaa0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216866.798831:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e641492800/0xf210a9075089ea99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089eaa0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216866.798907:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733937280:0@lo:256: 00000100:00100000:0.0:1782216866.798939:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216866.798963:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6485f9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782216866.799029:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733937280 00000100:00100000:1.0:1782216866.799034:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733937280 00000100:00100000:1.0:1782216866.799057:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1782216866.799064:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+17:5780:x1868789733937280:12345-0@lo:256: 20000000:01000000:1.0:1782216866.799077:0:5778:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1782216866.799093:0:5778:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1782216866.799096:0:5778:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1782216866.799167:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+17:5780:x1868789733937280:12345-0@lo:256: Request processed in 102us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216866.799174:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1782216866.799244:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733937280:0@lo:256: 10000000:01000000:0.0:1782216866.799284:0:5780:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782216866.799290:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e641492800/0xf210a9075089ea99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089eaa0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216866.799298:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e641492800/0xf210a9075089ea99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089eaa0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216866.799306:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1782216866.799308:0:5780:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1782216866.799311:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1782216866.799326:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e640030400/0xf210a9075089eaa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216866.799333:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e640030400/0xf210a9075089eaa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216866.799340:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e640030400/0xf210a9075089eaa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216866.799352:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733937408:0@lo:101: 00000100:00100000:0.0:1782216866.799461:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216866.799488:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6738e7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782216866.799529:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733937408 00000100:00100000:1.0:1782216866.799533:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733937408 00000100:00100000:1.0:1782216866.799558:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1782216866.799563:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+17:5780:x1868789733937408:12345-0@lo:101: 00010000:00010000:1.0:1782216866.799569:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782216866.799577:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e641493a00/0xf210a9075089eaae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089eaa7 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216866.799591:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e641493a00/0xf210a9075089eaae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089eaa7 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216866.799599:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e641493a00/0xf210a9075089eaae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089eaa7 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216866.799612:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e641493a00, rc 0) 00000100:00100000:1.0:1782216866.799643:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+18:5780:x1868789733937408:12345-0@lo:101: Request processed in 79us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216866.799649:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1782216866.799678:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733937408:0@lo:101: 00010000:00010000:1.0:1782216866.799689:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e640030400/0xf210a9075089eaa7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089eaae expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216866.799697:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e640030400/0xf210a9075089eaa7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089eaae expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216866.799735:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733937536:0@lo:501: 00000100:00100000:1.0:1782216866.799759:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216866.799771:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6805b8300 going to sleep for 11 seconds 00000100:00100000:1.0:1782216866.799781:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733937536 00000100:00100000:1.0:1782216866.799784:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733937536 00000100:00100000:1.0:1782216866.799799:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1782216866.799805:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+18:5780:x1868789733937536:12345-0@lo:501: 00000100:00100000:1.0:1782216866.800037:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+18:5780:x1868789733937536:12345-0@lo:501: Request processed in 231us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216866.800044:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1782216866.800074:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733937536:0@lo:501: 00000100:00100000:1.0:1782216866.800096:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733937664:0@lo:503: 00000100:00100000:1.0:1782216866.800130:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216866.800143:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6805b8300 going to sleep for 11 seconds 00000100:00100000:1.0:1782216866.800157:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733937664 00000100:00100000:1.0:1782216866.800161:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733937664 00000100:00100000:1.0:1782216866.800176:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1782216866.800181:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+18:5780:x1868789733937664:12345-0@lo:503: 00000100:00100000:1.0:1782216866.800780:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+18:5780:x1868789733937664:12345-0@lo:503: Request processed in 594us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216866.800787:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1782216866.804222:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733937664:0@lo:503: 00000100:00100000:0.0:1782216866.807800:0:7775:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:7775:1868789733937792:0@lo:502: 00000100:00100000:0.0:1782216866.807900:0:7775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216866.807937:0:7775:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6738e7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782216866.808000:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733937792 00000100:00100000:1.0:1782216866.808008:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733937792 00000100:00100000:1.0:1782216866.808059:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1782216866.808070:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+18:7775:x1868789733937792:12345-0@lo:502: 00000100:00100000:1.0:1782216866.808367:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+18:7775:x1868789733937792:12345-0@lo:502: Request processed in 299us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216866.808376:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1782216866.808540:0:7775:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:7775:1868789733937792:0@lo:502: 00000020:01000000:0.0:1782216866.808564:0:7775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1782216866.808570:0:7775:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1782216866.808576:0:7775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782216866.808579:0:7775:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1782216866.808583:0:7775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1782216866.808587:0:7775:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.119@tcp to nid 0x20000c0a8cb77 (192.168.203.119@tcp) 00000020:01000000:0.0:1782216866.808605:0:7775:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1782216866.808608:0:7775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782216866.808629:0:7775:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff88e67fff8000) 00000020:00000080:0.0:1782216866.808646:0:7775:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1782216866.808651:0:7775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1782216866.808711:0:7775:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1782216866.808716:0:7775:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:0.0:1782216866.808722:0:7775:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf210a9075089eabc 00010000:00080000:0.0:1782216866.808746:0:7775:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88e652466800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.119@tcp at head 00010000:00010000:0.0:1782216866.808975:0:7775:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1782216866.809246:0:7775:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1782216866.809257:0:7775:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1782216866.813955:0:7775:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782216866.814206:0:7775:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782216866.814258:0:7775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1782216866.814318:0:7775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1782216866.814943:0:7776:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782216866.814949:0:7776:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1782216866.815611:0:7775:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782216866.815623:0:7775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1782216866.815656:0:7775:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1782216866.815679:0:7775:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf210a9075089eac3 00000100:00080000:2.0:1782216866.815691:0:7775:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782216866.815697:0:7775:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88e652466800 using connection 192.168.203.119@tcp/0@lo 00000100:00100000:2.0:1782216866.815729:0:7775:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88e652481f80 x1868789733937920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782216866.815757:0:7775:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1782216866.815812:0:7775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782216866.815816:0:7775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782216866.815819:0:7775:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1782216866.815821:0:7775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782216866.815825:0:7775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782216866.815827:0:7775:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1782216866.815830:0:7775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1782216866.815831:0:7775:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1782216866.815857:0:7775:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652483100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:7775:1868789733938048:0@lo:502: 00000100:00100000:2.0:1782216866.815959:0:7775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216866.815992:0:7775:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e68058df00 going to sleep for 11 seconds 00000100:00100000:1.0:1782216866.816135:0:3300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652481f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1868789733937920:0@lo:8: 00000100:00100000:1.0:1782216866.816170:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216866.816209:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733938048 00000100:00100000:1.0:1782216866.816214:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733938048 00000100:00100000:1.0:1782216866.816248:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1782216866.816255:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+18:7775:x1868789733938048:12345-0@lo:502: 00000100:00100000:1.0:1782216866.816489:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+18:7775:x1868789733938048:12345-0@lo:502: Request processed in 232us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216866.816497:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1782216866.816627:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733937920 00000100:00100000:2.0:1782216866.816632:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733937920 00000100:00100000:2.0:1782216866.816662:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782216866.816667:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3300:x1868789733937920:12345-0@lo:8: 00010000:00080000:2.0:1782216866.816697:0:6578:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:2.0:1782216866.816720:0:6578:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf210a9075089eaca 00002000:00100000:2.0:1782216866.816734:0:6578:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff88e67a473000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1782216866.816738:0:6578:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1782216866.816741:0:6578:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1782216866.816846:0:6578:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1782216866.817009:0:6578:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1782216866.817032:0:6578:0:(import.c:65:import_set_state_nolock()) ffff88e67a474800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782216866.817072:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1868789733937920:12345-0@lo:8: Request processed in 403us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216866.817079:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782216866.817114:0:7775:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652483100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:7775:1868789733938048:0@lo:502: 00000020:01000000:2.0:1782216866.817141:0:7775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782216866.817146:0:7775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782216866.817149:0:7775:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1782216866.817152:0:7775:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1782216866.817527:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1782216866.817555:0:5780:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1782216866.817565:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e640030400/0xf210a9075089eaa7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089eaae expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216866.817575:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e640030400/0xf210a9075089eaa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089eaae expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782216866.817585:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1782216866.817587:0:5780:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff88e6484dcd40 from 1 10000000:01000000:1.0:1782216866.817590:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1782216866.817617:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e641493600/0xf210a9075089ead1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216866.817625:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e641493600/0xf210a9075089ead1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216866.817633:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e641493600/0xf210a9075089ead1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216866.817650:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733938176:0@lo:101: 00000100:00100000:1.0:1782216866.817685:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216866.817716:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e646214e40 going to sleep for 11 seconds 00010000:00080000:1.0:1782216866.817749:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e652481f80 x1868789733937920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782216876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216866.817760:0:3300:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782216866.817766:0:3300:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1782216866.817774:0:3300:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1782216866.817779:0:3300:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1782216866.817782:0:3300:0:(import.c:65:import_set_state_nolock()) ffff88e652466800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1782216866.817805:0:3300:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1782216866.817811:0:3300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652481f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1868789733937920:0@lo:8: 00000100:00100000:0.0:1782216866.817867:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733938176 00000100:00100000:0.0:1782216866.817905:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733938176 00000100:00100000:0.0:1782216866.817938:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1782216866.817947:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+18:5780:x1868789733938176:12345-0@lo:101: 00010000:00010000:0.0:1782216866.817957:0:5775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216866.817968:0:5775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e640030a00/0xf210a9075089ead8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089ead1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216866.817991:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e640030a00/0xf210a9075089ead8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089ead1 expref: 19 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216866.818001:0:5775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e640030a00/0xf210a9075089ead8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089ead1 expref: 19 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216866.818010:0:5775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e640030a00, rc 0) 00000100:00100000:0.0:1782216866.818044:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+19:5780:x1868789733938176:12345-0@lo:101: Request processed in 98us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216866.818050:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000004:00080000:0.0:1782216866.818078:0:7776:0:(osp_sync.c:1060:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1782216866.818179:0:7776:0:(osp_sync.c:1862:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 185870300749ns, next at 0ns, rc = 0 00000100:00100000:1.0:1782216866.818275:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733938176:0@lo:101: 00010000:00010000:1.0:1782216866.818286:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e641493600/0xf210a9075089ead1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ead8 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216866.818295:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e641493600/0xf210a9075089ead1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089ead8 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216866.818336:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733938304:0@lo:501: 00000100:00100000:1.0:1782216866.818362:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216866.818376:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e646214e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782216866.819689:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733938304 00000100:00100000:1.0:1782216866.819701:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733938304 00000100:00100000:1.0:1782216866.819752:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1782216866.819761:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+19:5780:x1868789733938304:12345-0@lo:501: 00000100:00100000:1.0:1782216866.820011:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+19:5780:x1868789733938304:12345-0@lo:501: Request processed in 249us (1646us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782216866.820018:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1782216866.820066:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733938304:0@lo:501: 10000000:01000000:1.0:1782216866.820097:0:5780:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1782216866.820105:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e641493600/0xf210a9075089ead1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ead8 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216866.820114:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e641493600/0xf210a9075089ead1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ead8 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782216866.866041:0:5805:0:(osp_sync.c:1827:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1782216866.914802:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733938432:0@lo:13: 00000100:00100000:1.0:1782216866.914870:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1782216866.914979:0:7777:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1782216866.915002:0:7777:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a801500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7777:1868789733938560:0@lo:7: 00000100:00100000:3.0:1782216866.915034:0:7777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216866.915058:0:7777:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e65f4379c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782216866.915108:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733938560 00000100:00100000:0.0:1782216866.915116:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733938560 00000100:00100000:0.0:1782216866.915183:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782216866.915192:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7777:x1868789733938560:12345-0@lo:7: 00000100:00080000:3.0:1782216866.918658:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782216866.918981:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733938432 00000100:00100000:1.0:1782216866.918991:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733938432 00000100:00100000:1.0:1782216866.919037:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782216866.919047:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1868789733938432:12345-0@lo:13: 00002000:00000024:1.0:1782216866.919078:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1782216866.919151:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1868789733938432:12345-0@lo:13: Request processed in 106us (4281us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216866.919159:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1782216866.919215:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67a802a00 x1868789733938432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216882 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216866.919234:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733938432:0@lo:13: 00002000:00080000:0.0:1782216866.922588:0:6580:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1782216866.922595:0:6580:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1782216866.922683:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7777:x1868789733938560:12345-0@lo:7: Request processed in 7488us (7644us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216866.922694:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1782216866.923217:0:7777:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67a801500 x1868789733938560/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782216882 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216866.923233:0:7777:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a801500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7777:1868789733938560:0@lo:7: 00000004:00080000:3.0:1782216866.923247:0:7777:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1782216866.923281:0:7777:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a801500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7777:1868789733938688:0@lo:5: 00000100:00100000:3.0:1782216866.923314:0:7777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216866.923371:0:7777:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e65f4379c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782216866.923497:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733938688 00000100:00100000:1.0:1782216866.923504:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733938688 00000100:00100000:1.0:1782216866.923554:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782216866.923564:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7777:x1868789733938688:12345-0@lo:5: 00002000:00080000:1.0:1782216866.923589:0:6579:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1782216866.923593:0:6579:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1782216866.923846:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7777:x1868789733938688:12345-0@lo:5: Request processed in 283us (530us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1782216866.923853:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1782216866.923907:0:7777:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67a801500 x1868789733938688/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782216882 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216866.923919:0:7777:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a801500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7777:1868789733938688:0@lo:5: 00000004:00080000:1.0:1782216866.923935:0:7777:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1782216866.923959:0:7777:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b95f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7777:1868789733938816:0@lo:700: 00000100:00100000:1.0:1782216866.923985:0:7777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216866.924002:0:7777:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6475636c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782216866.924016:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733938816 00000100:00100000:1.0:1782216866.924019:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733938816 00000100:00100000:1.0:1782216866.924042:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782216866.924049:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7777:x1868789733938816:12345-0@lo:700: 00000100:00100000:1.0:1782216866.924073:0:6586:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6586:1868789733938944:0@lo:700: 00000100:00100000:1.0:1782216866.924101:0:6586:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216866.924122:0:6586:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6475639c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782216866.925258:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733938944 00000100:00100000:0.0:1782216866.925274:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733938944 00000100:00100000:0.0:1782216866.925506:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782216866.925515:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6586:x1868789733938944:12345-0@lo:700: 40000000:02000000:0.0:1782216866.982661:0:5790:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1782216866.988038:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6586:x1868789733938944:12345-0@lo:700: Request processed in 62517us (63927us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216866.988052:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1782216866.988235:0:6586:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e648b94a80 x1868789733938944/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1782216882 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216866.988251:0:6586:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6586:1868789733938944:0@lo:700: 40000000:02000000:1.0:1782216866.988264:0:6586:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:2.0:1782216867.126499:0:7488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1782216867.126516:0:7488:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1782216867.128178:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7777:x1868789733938816:12345-0@lo:700: Request processed in 204121us (204184us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216867.128198:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1782216867.128333:0:7777:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e648b95f80 x1868789733938816/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1782216882 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216867.128345:0:7777:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1782216867.128362:0:7777:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b95f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7777:1868789733938816:0@lo:700: 00000004:02000040:1.0:1782216867.184339:0:7777:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1782216867.204329:0:7777:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7777:1868789733939072:0@lo:5: 00000100:00100000:0.0:1782216867.204520:0:7777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216867.204630:0:7777:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e650716e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782216867.211620:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733939072 00000100:00100000:2.0:1782216867.211634:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733939072 00000100:00100000:3.0:1782216867.211899:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782216867.211911:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7777:x1868789733939072:12345-0@lo:5: 00002000:00080000:3.0:1782216867.225797:0:6580:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1782216867.225817:0:6580:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1782216867.231616:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7777:x1868789733939072:12345-0@lo:5: Request processed in 19699us (27087us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1782216867.231630:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1782216867.231708:0:7777:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67a1e6a00 x1868789733939072/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782216883 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216867.231725:0:7777:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7777:1868789733939072:0@lo:5: 00000004:00080000:0.0:1782216867.231738:0:7777:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1782216867.414963:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782216867.657590:0:7837:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg319-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1782216868.436077:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216869.462451:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216869.844157:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733939200:0@lo:13: 00000100:00100000:3.0:1782216869.844227:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216869.844349:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733939200 00000100:00100000:0.0:1782216869.844357:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733939200 00000100:00100000:0.0:1782216869.844431:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782216869.844439:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733939200:12345-0@lo:13: 00002000:00000024:0.0:1782216869.844472:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782216869.844515:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733939200:12345-0@lo:13: Request processed in 77us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216869.844521:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1782216869.844630:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782216869.844661:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67a1e6300 x1868789733939200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216885 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216869.844678:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733939200:0@lo:13: 00010000:00010000:3.0:1782216870.486038:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216871.513544:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216871.893230:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868789733939456:0@lo:400: 00000100:00100000:2.0:1782216871.893292:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216871.893340:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733939968:0@lo:400: 00000100:00100000:2.0:1782216871.893378:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216871.893428:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1782216871.893435:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733939328:0@lo:400: 00000100:00100000:2.0:1782216871.893461:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216871.893479:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652481f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1868789733939840:0@lo:400: 00000100:00100000:2.0:1782216871.893498:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216871.893524:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733939584:0@lo:400: 00000100:00100000:2.0:1782216871.893556:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216871.893575:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782216871.893581:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652483b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1868789733939712:0@lo:400: 00000100:00100000:2.0:1782216871.893601:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216871.893629:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733939456 00000100:00100000:2.0:1782216871.893636:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733939456 00000100:00100000:2.0:1782216871.893671:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733939840 00000100:00100000:2.0:1782216871.893674:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733939840 00000100:00100000:2.0:1782216871.893690:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733939712 00000100:00100000:2.0:1782216871.893693:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733939712 00000100:00100000:2.0:1782216871.893706:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782216871.893713:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868789733939456:12345-0@lo:400: 00000100:00100000:2.0:1782216871.893762:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868789733939456:12345-0@lo:400: Request processed in 48us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216871.893769:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782216871.893786:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782216871.893792:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868789733939840:12345-0@lo:400: 00000100:00100000:2.0:1782216871.893817:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868789733939840:12345-0@lo:400: Request processed in 26us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216871.893823:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782216871.893834:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782216871.893839:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fff5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1868789733939712:12345-0@lo:400: 00000100:00100000:2.0:1782216871.893900:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fff5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1868789733939712:12345-0@lo:400: Request processed in 60us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216871.893906:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782216871.893930:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733939968 00000100:00100000:2.0:1782216871.893933:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733939968 00000100:00100000:2.0:1782216871.893954:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733939584 00000100:00100000:2.0:1782216871.893957:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733939584 00000100:00100000:2.0:1782216871.893968:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782216871.893973:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1868789733939968:12345-0@lo:400: 00000100:00100000:1.0:1782216871.895114:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733939328 00000100:00100000:1.0:1782216871.895123:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733939328 00000100:00100000:1.0:1782216871.895160:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1782216871.895174:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+19:3304:x1868789733939328:12345-0@lo:400: 00000100:00100000:1.0:1782216871.913406:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+19:3304:x1868789733939328:12345-0@lo:400: Request processed in 18224us (19935us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216871.913421:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:1.0:1782216871.913509:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782216871.913513:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782216871.913517:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782216871.913539:0:6579:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1782216871.913547:0:6579:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1782216871.913595:0:6580:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1782216871.913606:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782216871.913618:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fff5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733939584:12345-0@lo:400: 00000100:00100000:1.0:1782216871.913673:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fff5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733939584:12345-0@lo:400: Request processed in 59us (20116us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216871.913681:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1782216871.913737:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e652483b80 x1868789733939712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216871.913753:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652483b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1868789733939712:0@lo:400: 00010000:00080000:1.0:1782216871.913767:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e652483480 x1868789733939584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216871.913776:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733939584:0@lo:400: 00000100:00100000:1.0:1782216871.913816:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733939328:0@lo:400: 00010000:00080000:1.0:1782216871.913829:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e652481f80 x1868789733939840/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216871.913838:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652481f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1868789733939840:0@lo:400: 00010000:00080000:1.0:1782216871.913867:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e652482d80 x1868789733939456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216871.913904:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868789733939456:0@lo:400: 00000100:00100000:2.0:1782216871.914070:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1868789733939968:12345-0@lo:400: Request processed in 20093us (20689us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216871.914079:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1782216871.914147:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e652480380 x1868789733939968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216871.914157:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733939968:0@lo:400: 00000100:00100000:0.0:1782216872.409724:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782216872.409750:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733940096:0@lo:13: 00000100:00100000:0.0:1782216872.409830:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216872.409904:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733940096 00000100:00100000:0.0:1782216872.409911:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733940096 00000100:00100000:0.0:1782216872.409956:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782216872.409965:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1868789733940096:12345-0@lo:13: 00002000:00000024:0.0:1782216872.409994:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782216872.410036:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1868789733940096:12345-0@lo:13: Request processed in 72us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216872.410044:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1782216872.410841:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67a1e5880 x1868789733940096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216888 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216872.410864:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733940096:0@lo:13: 00000001:00080000:0.0:1782216872.506235:0:7488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1782216872.537843:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216873.563755:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782216873.820935:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782216873.821147:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713993856 00000100:00100000:0.0:1782216873.821157:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713993856 00000100:00100000:0.0:1782216873.821204:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 111 00000100:00100000:0.0:1782216873.821213:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2355:x1868789713993856:12345-192.168.203.19@tcp:250: 00010000:00080000:0.0:1782216873.821249:0:5775:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e@192.168.203.19@tcp t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:0.0:1782216873.821273:0:5775:0:(genops.c:1406:class_connect()) connect: client 4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e, cookie 0xf210a9075089eadf 00000100:00080000:0.0:1782216873.823394:0:5775:0:(import.c:65:import_set_state_nolock()) ffff88e652467000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782216873.823477:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+5:2355:x1868789713993856:12345-192.168.203.19@tcp:250: Request processed in 2262us (2548us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216873.823487:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 111 00000100:00100000:3.0:1782216873.830745:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216873.831153:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713993984 00000100:00100000:1.0:1782216873.831162:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713993984 00000100:00100000:1.0:1782216873.831216:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 112 00000100:00100000:1.0:1782216873.831226:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+5:5558:x1868789713993984:12345-192.168.203.19@tcp:101: 00010000:00010000:1.0:1782216873.831241:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782216873.831258:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e641493800/0xf210a9075089eae6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620132 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216873.831285:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e641493800/0xf210a9075089eae6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620132 expref: 6 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216873.831297:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e641493800/0xf210a9075089eae6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620132 expref: 6 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216873.831481:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e641493800, rc 0) 00000100:00100000:1.0:1782216873.832414:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+6:5558:x1868789713993984:12345-192.168.203.19@tcp:101: Request processed in 1185us (1673us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216873.832422:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 112 00000100:00100000:3.0:1782216873.847855:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216873.847955:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713994112 00000100:00100000:2.0:1782216873.847965:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713994112 00000100:00100000:2.0:1782216873.848014:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 113 00000100:00100000:2.0:1782216873.848023:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+6:5558:x1868789713994112:12345-192.168.203.19@tcp:501: 00000100:00100000:2.0:1782216873.848252:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+6:5558:x1868789713994112:12345-192.168.203.19@tcp:501: Request processed in 229us (405us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782216873.848262:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 113 00000100:00100000:1.0:1782216873.857072:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216873.857147:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713994240 00000100:00100000:3.0:1782216873.857158:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713994240 00000100:00100000:3.0:1782216873.857210:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 114 00000100:00100000:3.0:1782216873.857219:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+6:5558:x1868789713994240:12345-192.168.203.19@tcp:101: 00010000:00010000:3.0:1782216873.857236:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782216873.857252:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e653161000/0xf210a9075089eaed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620139 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216873.857280:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e653161000/0xf210a9075089eaed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620139 expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216873.857321:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e653161000/0xf210a9075089eaed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620139 expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216873.857338:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e653161000, rc 0) 00000100:00100000:3.0:1782216873.857385:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+7:5558:x1868789713994240:12345-192.168.203.19@tcp:101: Request processed in 167us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216873.857391:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 114 00000100:00100000:3.0:1782216873.860592:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216873.860724:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713994368 00000100:00100000:2.0:1782216873.860732:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713994368 00000100:00100000:2.0:1782216873.860781:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 115 00000100:00100000:2.0:1782216873.860790:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+7:5558:x1868789713994368:12345-192.168.203.19@tcp:501: 00000100:00100000:2.0:1782216873.861098:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+8:5558:x1868789713994368:12345-192.168.203.19@tcp:501: Request processed in 307us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216873.861106:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 115 00000100:00100000:1.0:1782216873.864140:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216873.864199:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713994496 00000100:00100000:3.0:1782216873.864207:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713994496 00000100:00100000:3.0:1782216873.864251:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 116 00000100:00100000:3.0:1782216873.864259:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+8:5558:x1868789713994496:12345-192.168.203.19@tcp:503: 00000100:00100000:3.0:1782216873.864489:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+8:5558:x1868789713994496:12345-192.168.203.19@tcp:503: Request processed in 230us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216873.864497:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 116 00000100:00100000:2.0:1782216873.876314:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216873.876395:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713994624 00000100:00100000:3.0:1782216873.876404:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713994624 00000100:00100000:3.0:1782216873.876458:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 117 00000100:00100000:3.0:1782216873.876469:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+8:5576:x1868789713994624:12345-192.168.203.19@tcp:502: 00000100:00100000:3.0:1782216873.876780:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+8:5576:x1868789713994624:12345-192.168.203.19@tcp:502: Request processed in 311us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216873.876789:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 117 00000100:00100000:0.0:1782216873.915015:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216873.915097:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713994752 00000100:00100000:1.0:1782216873.915106:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713994752 00000100:00100000:1.0:1782216873.915152:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 118 00000100:00100000:1.0:1782216873.915176:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+8:5576:x1868789713994752:12345-192.168.203.19@tcp:502: 00000100:00100000:1.0:1782216873.915585:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+8:5576:x1868789713994752:12345-192.168.203.19@tcp:502: Request processed in 352us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216873.915594:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 118 00000100:00100000:0.0:1782216873.921264:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216873.921544:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713994880 00000100:00100000:2.0:1782216873.921554:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713994880 00000100:00100000:2.0:1782216873.921601:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 119 00000100:00100000:2.0:1782216873.921611:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+8:5558:x1868789713994880:12345-192.168.203.19@tcp:101: 00010000:00010000:2.0:1782216873.921625:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216873.921641:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e67a2d2800/0xf210a9075089eaf4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620163 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216873.921666:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e67a2d2800/0xf210a9075089eaf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620163 expref: 9 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216873.921677:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e67a2d2800/0xf210a9075089eaf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620163 expref: 9 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216873.921686:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67a2d2800, rc 0) 00000100:00100000:2.0:1782216873.921730:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+9:5558:x1868789713994880:12345-192.168.203.19@tcp:101: Request processed in 121us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216873.921737:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 119 00000100:00100000:0.0:1782216873.927471:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216873.927997:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713995008 00000100:00100000:1.0:1782216873.928007:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713995008 00000100:00100000:1.0:1782216873.928057:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 120 00000100:00100000:1.0:1782216873.928067:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+9:5558:x1868789713995008:12345-192.168.203.19@tcp:256: 20000000:01000000:1.0:1782216873.928090:0:5778:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1782216873.928111:0:5778:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1782216873.928115:0:5778:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1782216873.928117:0:5778:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1782216873.928119:0:5778:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1782216873.939852:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+9:5558:x1868789713995008:12345-192.168.203.19@tcp:256: Request processed in 11775us (12379us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216873.939866:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 120 00000100:00100000:1.0:1782216873.954951:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216873.954992:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713995136 00000100:00100000:1.0:1782216873.955001:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713995136 00000100:00100000:1.0:1782216873.955043:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 121 00000100:00100000:1.0:1782216873.955053:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e65774ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+9:5558:x1868789713995136:12345-192.168.203.19@tcp:101: 00010000:00010000:1.0:1782216873.955069:0:5775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782216873.955085:0:5775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e67fd07a00/0xf210a9075089eafb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62016a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216873.955112:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e67fd07a00/0xf210a9075089eafb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62016a expref: 10 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216873.955138:0:5775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e67fd07a00/0xf210a9075089eafb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62016a expref: 10 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216873.955147:0:5775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd07a00, rc 0) 00000100:00100000:1.0:1782216873.955197:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e65774ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:5558:x1868789713995136:12345-192.168.203.19@tcp:101: Request processed in 145us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216873.955203:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 121 00000100:00100000:0.0:1782216873.968611:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216873.968738:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713995264 00000100:00100000:3.0:1782216873.968749:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713995264 00000100:00100000:3.0:1782216873.968800:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 122 00000100:00100000:3.0:1782216873.968810:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e65774d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:5558:x1868789713995264:12345-192.168.203.19@tcp:501: 00000100:00100000:3.0:1782216873.969095:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e65774d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:5558:x1868789713995264:12345-192.168.203.19@tcp:501: Request processed in 285us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216873.969103:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 122 00000100:00100000:2.0:1782216873.983462:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216873.983711:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713995392 00000100:00100000:1.0:1782216873.983721:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713995392 00000100:00100000:1.0:1782216873.983776:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 123 00000100:00100000:1.0:1782216873.983785:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e65774f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:5558:x1868789713995392:12345-192.168.203.19@tcp:503: 00000100:00100000:1.0:1782216873.984163:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e65774f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:5558:x1868789713995392:12345-192.168.203.19@tcp:503: Request processed in 377us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216873.984171:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 123 00000100:00100000:0.0:1782216873.991367:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216873.992266:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713995520 00000100:00100000:2.0:1782216873.992277:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713995520 00000100:00100000:2.0:1782216873.992357:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 124 00000100:00100000:2.0:1782216873.992365:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e65774d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:5579:x1868789713995520:12345-192.168.203.19@tcp:502: 00000100:00100000:2.0:1782216873.992637:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e65774d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:5579:x1868789713995520:12345-192.168.203.19@tcp:502: Request processed in 271us (1277us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216873.992645:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 124 00000100:00100000:2.0:1782216873.995351:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216873.995424:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713995648 00000100:00100000:3.0:1782216873.995434:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713995648 00000100:00100000:3.0:1782216873.995480:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 125 00000100:00100000:3.0:1782216873.995490:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e65774c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:5579:x1868789713995648:12345-192.168.203.19@tcp:502: 00000100:00100000:3.0:1782216873.995696:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e65774c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:5579:x1868789713995648:12345-192.168.203.19@tcp:502: Request processed in 207us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216873.995704:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 125 00000100:00100000:3.0:1782216873.998350:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782216873.998857:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713995776 00000100:00100000:0.0:1782216873.998867:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713995776 00000100:00100000:0.0:1782216873.998942:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 4 00000100:00100000:0.0:1782216873.998950:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a800e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2355:x1868789713995776:12345-192.168.203.19@tcp:38: 00010000:00080000:0.0:1782216873.998979:0:5783:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 10ba4d21-74e8-42e8-8e52-48a327751cbd@192.168.203.19@tcp t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:0.0:1782216873.999026:0:5783:0:(genops.c:1406:class_connect()) connect: client 10ba4d21-74e8-42e8-8e52-48a327751cbd, cookie 0xf210a9075089eb02 00000004:00100000:0.0:1782216873.999056:0:5783:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1782216873.999062:0:5783:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1782216874.071267:0:5783:0:(import.c:65:import_set_state_nolock()) ffff88e652465000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782216874.071369:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a800e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2355:x1868789713995776:12345-192.168.203.19@tcp:38: Request processed in 72416us (73024us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216874.071381:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 4 00010000:00010000:3.0:1782216874.580122:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782216874.964224:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782216874.964246:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733940224:0@lo:13: 00000100:00100000:1.0:1782216874.964319:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216874.964692:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733940224 00000100:00100000:0.0:1782216874.964699:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733940224 00000100:00100000:0.0:1782216874.964761:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782216874.964771:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733940224:12345-0@lo:13: 00002000:00000024:0.0:1782216874.964815:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782216874.965180:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733940224:12345-0@lo:13: Request processed in 409us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216874.965187:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1782216874.965285:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67a1e5880 x1868789733940224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216890 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216874.965315:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733940224:0@lo:13: 00000100:00080000:1.0:1782216874.965946:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782216875.086538:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782216875.086577:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216875.086756:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713996032 00000100:00100000:3.0:1782216875.086766:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713996032 00000100:00100000:3.0:1782216875.086854:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713995904 00000100:00100000:3.0:1782216875.086858:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713995904 00000100:00100000:3.0:1782216875.086901:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 5 00000100:00100000:3.0:1782216875.086911:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:5558:x1868789713996032:12345-192.168.203.19@tcp:41: 00000004:00000024:3.0:1782216875.086951:0:5784:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1782216875.087013:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:5558:x1868789713996032:12345-192.168.203.19@tcp:41: Request processed in 102us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216875.087020:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 5 00000100:00100000:3.0:1782216875.087038:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 6 00000100:00100000:3.0:1782216875.087059:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:0:x1868789713995904:12345-192.168.203.19@tcp:41: 00000004:00000024:3.0:1782216875.087071:0:5784:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1782216875.087092:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:0:x1868789713995904:12345-192.168.203.19@tcp:41: Request processed in 34us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216875.087098:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 6 00000100:00080000:2.0:1782216875.087242:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782216875.090313:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216875.090486:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713996160 00000100:00100000:3.0:1782216875.090494:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713996160 00000100:00100000:3.0:1782216875.090554:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 7 00000100:00100000:3.0:1782216875.090565:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fff6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:5558:x1868789713996160:12345-192.168.203.19@tcp:40: 00000100:00100000:3.0:1782216875.090648:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fff6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:5558:x1868789713996160:12345-192.168.203.19@tcp:40: Request processed in 84us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216875.090656:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 7 00000100:00100000:3.0:1782216875.100001:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216875.100041:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216875.100077:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216875.100167:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713996288 00000100:00100000:2.0:1782216875.100176:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713996288 00000100:00100000:2.0:1782216875.100218:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713996416 00000100:00100000:2.0:1782216875.100222:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713996416 00000100:00100000:2.0:1782216875.100240:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 9 00000100:00100000:2.0:1782216875.100247:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2355:x1868789713996288:12345-192.168.203.19@tcp:8: 00010000:00080000:2.0:1782216875.100275:0:6578:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 10ba4d21-74e8-42e8-8e52-48a327751cbd@192.168.203.19@tcp t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:2.0:1782216875.100315:0:6578:0:(genops.c:1406:class_connect()) connect: client 10ba4d21-74e8-42e8-8e52-48a327751cbd, cookie 0xf210a9075089eb09 00002000:00100000:2.0:1782216875.100333:0:6578:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 10ba4d21-74e8-42e8-8e52-48a327751cbd/ffff88e67a470800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782216875.100344:0:6578:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782216875.100614:0:6578:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1782216875.100653:0:6578:0:(import.c:65:import_set_state_nolock()) ffff88e67a472000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782216875.100707:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2355:x1868789713996288:12345-192.168.203.19@tcp:8: Request processed in 460us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216875.100715:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 9 00000100:00100000:2.0:1782216875.100731:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 10 00000100:00100000:2.0:1782216875.100735:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2355:x1868789713996416:12345-192.168.203.19@tcp:8: 00010000:00080000:2.0:1782216875.100748:0:6578:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 10ba4d21-74e8-42e8-8e52-48a327751cbd@192.168.203.19@tcp t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:2.0:1782216875.100762:0:6578:0:(genops.c:1406:class_connect()) connect: client 10ba4d21-74e8-42e8-8e52-48a327751cbd, cookie 0xf210a9075089eb10 00002000:00100000:2.0:1782216875.100778:0:6578:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 10ba4d21-74e8-42e8-8e52-48a327751cbd/ffff88e67a476000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782216875.100792:0:6578:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782216875.100992:0:6578:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1782216875.101014:0:6578:0:(import.c:65:import_set_state_nolock()) ffff88e67a471000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782216875.101038:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2355:x1868789713996416:12345-192.168.203.19@tcp:8: Request processed in 300us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216875.101045:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 10 00000100:00100000:0.0:1782216875.101585:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713996544 00000100:00100000:0.0:1782216875.101591:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713996544 00000100:00100000:0.0:1782216875.101651:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 126 00000100:00100000:0.0:1782216875.101659:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e65774e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:2357:x1868789713996544:12345-192.168.203.19@tcp:400: 00000100:00100000:0.0:1782216875.101703:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e65774e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:2357:x1868789713996544:12345-192.168.203.19@tcp:400: Request processed in 45us (1626us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216875.101711:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 126 00000100:00100000:3.0:1782216875.113015:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782216875.113154:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713996672 00000100:00100000:0.0:1782216875.113165:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713996672 00000100:00100000:0.0:1782216875.113223:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 0 00000100:00100000:0.0:1782216875.113234:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a801880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:5558:x1868789713996672:12345-192.168.203.19@tcp:33: 00000004:00080000:0.0:1782216875.145500:0:5786:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 32202us 00000004:00200000:0.0:1782216875.166109:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1782216875.166463:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a801880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:5558:x1868789713996672:12345-192.168.203.19@tcp:33: Request processed in 53226us (53453us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216875.166475:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 0 00000100:00100000:2.0:1782216875.532545:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782216875.532788:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713996800 00000100:00100000:0.0:1782216875.532798:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713996800 00000100:00100000:0.0:1782216875.532868:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 8 00000100:00100000:0.0:1782216875.532910:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fff6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:5596:x1868789713996800:12345-192.168.203.19@tcp:101: 00010000:00010000:0.0:1782216875.532929:0:6855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216875.532954:0:6855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089eb17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620194 expref: -99 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216875.533025:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089eb1e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216875.533038:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089eb1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216875.533068:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089eb1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782216875.533253:0:6855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1782216875.533257:0:6855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1782216875.533348:0:6855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089eb1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216875.533373:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089eb17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620194 expref: 8 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216875.533390:0:6855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089eb1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620194 expref: 7 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216875.533398:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e647d05a00) 00010000:00010000:0.0:1782216875.533401:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782216875.533404:0:6855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e640030600, rc 0) 00000100:00100000:0.0:1782216875.533459:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fff6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:5596:x1868789713996800:12345-192.168.203.19@tcp:101: Request processed in 582us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216875.533467:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 8 00010000:00010000:3.0:1782216875.604199:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216876.628146:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216877.016760:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a801c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789733940352:0@lo:400: 00000100:00100000:2.0:1782216877.016760:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a800000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868789733940480:0@lo:400: 00000100:00100000:2.0:1782216877.029208:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216877.029339:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733940992:0@lo:400: 00000100:00100000:2.0:1782216877.029382:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216877.029482:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1868789733940736:0@lo:400: 00000100:00100000:2.0:1782216877.029510:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216877.029530:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782216877.029537:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a803480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733940608:0@lo:400: 00000100:00100000:0.0:1782216877.030280:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733940992 00000100:00100000:0.0:1782216877.030299:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733940992 00000100:00100000:0.0:1782216877.030431:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782216877.030452:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733940992:12345-0@lo:400: 00000100:00100000:0.0:1782216877.030550:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733940992:12345-0@lo:400: Request processed in 106us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216877.030557:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1782216877.030583:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1782216877.030638:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67a803100 x1868789733940992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216877.030651:0:3304:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1782216877.030671:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733940992:0@lo:400: 00000100:00100000:0.0:1782216877.033139:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216877.037275:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733940480 00000100:00100000:1.0:1782216877.037291:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733940480 00000100:00100000:1.0:1782216877.037364:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733940736 00000100:00100000:1.0:1782216877.037368:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733940736 00000100:00100000:1.0:1782216877.037412:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782216877.037423:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fff4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868789733940480:12345-0@lo:400: 00000100:00100000:1.0:1782216877.037540:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fff4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868789733940480:12345-0@lo:400: Request processed in 118us (8342us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216877.037560:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782216877.037588:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782216877.037595:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1868789733940736:12345-0@lo:400: 00000100:00100000:1.0:1782216877.037634:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1868789733940736:12345-0@lo:400: Request processed in 40us (8123us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216877.037640:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782216877.037667:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733940608 00000100:00100000:1.0:1782216877.037671:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733940608 00000100:00100000:1.0:1782216877.037706:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782216877.037713:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733940608:12345-0@lo:400: 00000100:00100000:1.0:1782216877.037747:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733940608:12345-0@lo:400: Request processed in 35us (4628us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216877.037753:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1782216877.037784:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782216877.037790:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782216877.037852:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a800000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868789733940480:0@lo:400: 00010000:00080000:1.0:1782216877.037934:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67a803480 x1868789733940608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216877.037947:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a803480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733940608:0@lo:400: 00000100:00100000:1.0:1782216877.037960:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1868789733940736:0@lo:400: 00000100:00100000:3.0:1782216877.042201:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216877.042259:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733940352 00000100:00100000:3.0:1782216877.042271:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733940352 00000100:00100000:3.0:1782216877.042349:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1782216877.042362:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e65774f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+19:3303:x1868789733940352:12345-0@lo:400: 00000100:00100000:3.0:1782216877.042435:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e65774f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+19:3303:x1868789733940352:12345-0@lo:400: Request processed in 77us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216877.042562:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1782216877.042653:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a801c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789733940352:0@lo:400: 00000100:00100000:3.0:1782216877.042667:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1868789733940864:0@lo:400: 00000100:00100000:3.0:1782216877.042704:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216877.042731:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733940864 00000100:00100000:3.0:1782216877.042735:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733940864 00000100:00100000:3.0:1782216877.042777:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782216877.042784:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a801f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1868789733940864:12345-0@lo:400: 00000100:00100000:3.0:1782216877.042822:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a801f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1868789733940864:12345-0@lo:400: Request processed in 39us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216877.042828:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1782216877.042850:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782216877.042872:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1868789733940864:0@lo:400: 00000001:00100000:1.0:1782216877.137236:0:6609:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 10ba4d21-74e8-42e8-8e52-48a327751cbd 00000100:00100000:3.0:1782216877.524233:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733941120:0@lo:13: 00000100:00100000:3.0:1782216877.524358:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216877.524719:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733941120 00000100:00100000:2.0:1782216877.524730:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733941120 00000100:00100000:2.0:1782216877.524810:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782216877.524822:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733941120:12345-0@lo:13: 00002000:00000024:2.0:1782216877.524870:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782216877.530460:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733941120:12345-0@lo:13: Request processed in 5625us (6088us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216877.530479:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1782216877.532603:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67a1f3100 x1868789733941120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216893 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216877.532639:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733941120:0@lo:13: 00010000:00010000:3.0:1782216877.653233:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782216877.816559:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216877.816840:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713996928 00000100:00100000:2.0:1782216877.816853:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713996928 00000100:00100000:2.0:1782216877.817335:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 9 00000100:00100000:2.0:1782216877.817350:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:5648:x1868789713996928:12345-192.168.203.19@tcp:41: 00000004:00000024:2.0:1782216877.817411:0:5783:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00080000:3.0:1782216877.817591:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782216877.817720:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:5648:x1868789713996928:12345-192.168.203.19@tcp:41: Request processed in 374us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216877.817730:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 9 00000100:00100000:3.0:1782216877.828342:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216877.828524:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713997056 00000100:00100000:1.0:1782216877.828537:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713997056 00000100:00100000:1.0:1782216877.828622:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 9 00000100:00100000:1.0:1782216877.828654:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a801c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:5648:x1868789713997056:12345-192.168.203.19@tcp:13: 00002000:00000024:1.0:1782216877.828706:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782216877.828801:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a801c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:5648:x1868789713997056:12345-192.168.203.19@tcp:13: Request processed in 149us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216877.828818:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 9 00000100:00080000:3.0:1782216877.829208:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782216877.833012:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216877.837540:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713997184 00000100:00100000:1.0:1782216877.837564:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713997184 00000100:00100000:1.0:1782216877.837681:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 10 00000100:00100000:1.0:1782216877.837694:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:5648:x1868789713997184:12345-192.168.203.19@tcp:13: 00002000:00000024:1.0:1782216877.837730:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782216877.837845:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:5648:x1868789713997184:12345-192.168.203.19@tcp:13: Request processed in 153us (4855us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216877.837854:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 10 00000100:00080000:3.0:1782216877.839048:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782216878.677175:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1782216879.153166:0:5805:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 10ba4d21-74e8-42e8-8e52-48a327751cbd 00010000:00010000:3.0:1782216879.700803:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782216880.084549:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733941248:0@lo:13: 00000100:00100000:1.0:1782216880.084657:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216880.084866:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733941248 00000100:00100000:3.0:1782216880.084895:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733941248 00000100:00100000:3.0:1782216880.084973:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782216880.084984:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733941248:12345-0@lo:13: 00000100:00080000:0.0:1782216880.085008:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1782216880.085176:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782216880.085245:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733941248:12345-0@lo:13: Request processed in 263us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216880.085254:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1782216880.085352:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67a1f1f80 x1868789733941248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216896 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216880.085376:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733941248:0@lo:13: 00000100:00100000:0.0:1782216880.128386:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782216880.128423:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782216880.128451:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782216880.128476:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782216880.128499:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713997440 00000100:00100000:0.0:1782216880.128508:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713997440 00000100:00100000:0.0:1782216880.128559:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 19 00000100:00100000:0.0:1782216880.128569:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2358:x1868789713997440:12345-192.168.203.19@tcp:400: 00000100:00100000:0.0:1782216880.128633:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2358:x1868789713997440:12345-192.168.203.19@tcp:400: Request processed in 65us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216880.128640:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 19 00000100:00100000:0.0:1782216880.128661:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713997568 00000100:00100000:0.0:1782216880.128664:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713997568 00000100:00100000:0.0:1782216880.128685:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713997696 00000100:00100000:0.0:1782216880.128688:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713997696 00000100:00100000:0.0:1782216880.128705:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 7 00000100:00100000:0.0:1782216880.128710:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2358:x1868789713997568:12345-192.168.203.19@tcp:400: 00000100:00100000:0.0:1782216880.128732:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2358:x1868789713997568:12345-192.168.203.19@tcp:400: Request processed in 22us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216880.128738:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 7 00000100:00100000:0.0:1782216880.128760:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 8 00000100:00100000:0.0:1782216880.128765:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2358:x1868789713997696:12345-192.168.203.19@tcp:400: 00000100:00100000:1.0:1782216880.128863:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713997312 00000100:00100000:1.0:1782216880.128868:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713997312 00000100:00100000:1.0:1782216880.128914:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 128 00000100:00100000:1.0:1782216880.128921:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e68044f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:2358:x1868789713997312:12345-192.168.203.19@tcp:400: 00000100:00100000:1.0:1782216880.128944:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e68044f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:2358:x1868789713997312:12345-192.168.203.19@tcp:400: Request processed in 24us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216880.128949:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 128 00000100:00100000:0.0:1782216880.129056:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2358:x1868789713997696:12345-192.168.203.19@tcp:400: Request processed in 289us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216880.129063:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 8 00000100:00080000:0.0:1782216880.129078:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782216880.129082:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782216880.129085:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:0.0:1782216880.130591:0:7488:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 10ba4d21-74e8-42e8-8e52-48a327751cbd 00010000:00010000:3.0:1782216880.725922:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782216881.288470:0:8145:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1782216881.748109:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782216882.133629:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868789733941504:0@lo:400: 00000100:00100000:1.0:1782216882.133695:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216882.133744:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733942016:0@lo:400: 00000100:00100000:1.0:1782216882.133768:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216882.133797:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782216882.133802:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733941376:0@lo:400: 00000100:00100000:1.0:1782216882.133828:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216882.133847:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1868789733941888:0@lo:400: 00000100:00100000:1.0:1782216882.133867:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216882.133913:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733941632:0@lo:400: 00000100:00100000:1.0:1782216882.133937:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216882.133953:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782216882.133959:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1868789733941760:0@lo:400: 00000100:00100000:1.0:1782216882.133997:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216882.134031:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733941504 00000100:00100000:1.0:1782216882.134038:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733941504 00000100:00100000:1.0:1782216882.134073:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733941888 00000100:00100000:1.0:1782216882.134075:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733941888 00000100:00100000:1.0:1782216882.134095:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733941760 00000100:00100000:1.0:1782216882.134097:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733941760 00000100:00100000:1.0:1782216882.134109:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782216882.134116:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868789733941504:12345-0@lo:400: 00000100:00100000:1.0:1782216882.134165:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868789733941504:12345-0@lo:400: Request processed in 48us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216882.134171:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782216882.134331:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782216882.134340:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868789733941888:12345-0@lo:400: 00000100:00100000:1.0:1782216882.134379:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868789733941888:12345-0@lo:400: Request processed in 41us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216882.134385:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782216882.134396:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782216882.134401:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67426ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1868789733941760:12345-0@lo:400: 00000100:00100000:1.0:1782216882.134440:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67426ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1868789733941760:12345-0@lo:400: Request processed in 39us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216882.134446:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782216882.134465:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733942016 00000100:00100000:1.0:1782216882.134468:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733942016 00000100:00100000:0.0:1782216882.134628:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733941632 00000100:00100000:0.0:1782216882.134632:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733941632 00000100:00100000:0.0:1782216882.134659:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782216882.134666:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733941632:12345-0@lo:400: 00000100:00100000:0.0:1782216882.134698:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733941632:12345-0@lo:400: Request processed in 33us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216882.134704:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1782216882.134728:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782216882.134731:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782216882.134734:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782216882.134824:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733941376 00000100:00100000:1.0:1782216882.134828:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733941376 00000100:00100000:1.0:1782216882.134850:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1782216882.134855:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e68044d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+19:3304:x1868789733941376:12345-0@lo:400: 00000100:00100000:1.0:1782216882.134909:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e68044d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+19:3304:x1868789733941376:12345-0@lo:400: Request processed in 53us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216882.134915:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1782216882.134969:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782216882.134975:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733942016:12345-0@lo:400: 00000100:00100000:1.0:1782216882.135003:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733942016:12345-0@lo:400: Request processed in 28us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216882.135009:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782216882.135039:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733941376:0@lo:400: 00000100:00100000:1.0:1782216882.135051:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1868789733941888:0@lo:400: 00000100:00100000:1.0:1782216882.135061:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868789733941504:0@lo:400: 00010000:00080000:1.0:1782216882.135084:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e652482d80 x1868789733942016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216882.135094:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733942016:0@lo:400: 00000100:00100000:3.0:1782216882.135201:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1868789733941760:0@lo:400: 00010000:00080000:3.0:1782216882.135213:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e648b95500 x1868789733941632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216882.135222:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733941632:0@lo:400: 00000100:00100000:1.0:1782216882.644730:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782216882.644754:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67426c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733942144:0@lo:13: 00000100:00100000:1.0:1782216882.644827:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216882.644907:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733942144 00000100:00100000:1.0:1782216882.644914:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733942144 00000100:00100000:1.0:1782216882.644956:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782216882.644965:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67426ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733942144:12345-0@lo:13: 00002000:00000024:1.0:1782216882.645011:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782216882.645055:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67426ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733942144:12345-0@lo:13: Request processed in 91us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216882.645062:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1782216882.645099:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67426c380 x1868789733942144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216898 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216882.645116:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67426c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733942144:0@lo:13: 00010000:00010000:3.0:1782216882.772075:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216883.796987:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782216884.615016:0:8294:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcf436fc20 20000000:00000080:0.0:1782216884.615039:0:8294:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88e67f06a800 uarg=0000000000000000 20000000:01000000:0.0:1782216884.615350:0:8294:0:(mgs_llog.c:2004:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1782216884.615353:0:8294:0:(mgs_llog.c:6054:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1782216884.615356:0:8294:0:(mgs_llog.c:6085:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1782216884.615361:0:8294:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1782216884.615367:0:8294:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1782216884.615385:0:8294:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1782216884.615387:0:8294:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1782216884.616052:0:8294:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1782216884.616063:0:8294:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1782216884.619374:0:8295:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1782216884.620070:0:8294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1782216884.620145:0:8294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1782216884.620181:0:8294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1782216884.620199:0:8294:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1782216884.620202:0:8294:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1782216884.623089:0:8296:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1782216884.623637:0:8294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1782216884.623716:0:8294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1782216884.623771:0:8294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1782216884.623790:0:8294:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1782216884.623793:0:8294:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1782216884.629282:0:8297:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1782216884.633440:0:8294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1782216884.633527:0:8294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1782216884.633568:0:8294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1782216884.633586:0:8294:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1782216884.633589:0:8294:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1782216884.635273:0:8298:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1782216884.636311:0:8294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1782216884.636367:0:8294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1782216884.636399:0:8294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:2.0:1782216884.636433:0:8294:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1782216884.636457:0:8294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88e67a2d3800/0xf210a9075089eb25 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216884.636479:0:8294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88e641492600/0xf210a9075089ea22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089ea1b expref: 18 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216884.636487:0:8294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88e67a2d3600/0xf210a9075089ea4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089ea45 expref: 18 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216884.636508:0:8294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88e640031400/0xf210a9075089ea76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089ea6f expref: 18 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216884.636516:0:8294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88e67a2d3400/0xf210a9075089ea84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089ea7d expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216884.636524:0:8294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88e641492a00/0xf210a9075089ea92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089ea8b expref: 18 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216884.636532:0:8294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88e641493a00/0xf210a9075089eaae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089eaa7 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216884.636540:0:8294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88e640030a00/0xf210a9075089ead8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089ead1 expref: 18 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216884.636551:0:8294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88e641493800/0xf210a9075089eae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620132 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216884.636560:0:8294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88e653161000/0xf210a9075089eaed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620139 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216884.636569:0:8294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88e67a2d3800/0xf210a9075089eb25 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216884.636616:0:8294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88e653161000/0xf210a9075089eaed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620139 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216884.636636:0:8294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88e653161000/0xf210a9075089eaed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620139 expref: 9 pid: 5778 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216884.636670:0:8294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67fff5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8294:1868789733942272:192.168.203.19@tcp:104: 00010000:00010000:2.0:1782216884.636806:0:8294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88e641493800/0xf210a9075089eae6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620132 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216884.636815:0:8294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88e641493800/0xf210a9075089eae6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620132 expref: 9 pid: 5778 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216884.636825:0:8294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67fff5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8294:1868789733942400:192.168.203.19@tcp:104: 00010000:00010000:2.0:1782216884.636858:0:8294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88e640030a00/0xf210a9075089ead8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf210a9075089ead1 expref: 18 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216884.636866:0:8294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88e640030a00/0xf210a9075089ead8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf210a9075089ead1 expref: 18 pid: 5775 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216884.636897:0:8294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67fff4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8294:1868789733942528:0@lo:104: 00000100:00100000:2.0:1782216884.636946:0:8294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782216884.639042:0:8294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88e641493a00/0xf210a9075089eaae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf210a9075089eaa7 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216884.639042:0:6593:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1782216884.639061:0:8294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88e641493a00/0xf210a9075089eaae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf210a9075089eaa7 expref: 18 pid: 5778 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216884.639068:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733942528 00000100:00100000:2.0:1782216884.639076:0:8294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67fff7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8294:1868789733942656:0@lo:104: 00000100:00100000:0.0:1782216884.639079:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733942528 00000100:00100000:2.0:1782216884.639135:0:8294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216884.639142:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782216884.639153:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f295c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:526a4802-b871-4bcf-870f-067f11655366+3:8294:x1868789733942528:12345-0@lo:104: 00010000:00010000:0.0:1782216884.639180:0:6593:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.119@tcp lock: ffff88e641493600/0xf210a9075089ead1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089ead8 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.639243:0:6593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782216884.639250:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f295c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:526a4802-b871-4bcf-870f-067f11655366+3:8294:x1868789733942528:12345-0@lo:104: Request processed in 100us (2305us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216884.639271:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1782216884.639385:0:8294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88e641492a00/0xf210a9075089ea92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf210a9075089ea8b expref: 18 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216884.639395:0:8294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88e641492a00/0xf210a9075089ea92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf210a9075089ea8b expref: 18 pid: 5775 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216884.639418:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733942656 00000100:00100000:0.0:1782216884.639424:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733942656 00000100:00100000:2.0:1782216884.639432:0:8294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67fff6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8294:1868789733942784:0@lo:104: 00000100:00100000:2.0:1782216884.639466:0:8294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782216884.643189:0:8294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88e67a2d3400/0xf210a9075089ea84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf210a9075089ea7d expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216884.643213:0:8294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88e67a2d3400/0xf210a9075089ea84 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf210a9075089ea7d expref: 18 pid: 5778 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216884.643232:0:8294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67fff5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8294:1868789733942912:0@lo:104: 00000100:00100000:2.0:1782216884.643318:0:8294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216884.647098:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733942784 00000100:00100000:3.0:1782216884.647121:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733942784 00000100:00100000:3.0:1782216884.647189:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733942912 00000100:00100000:3.0:1782216884.647193:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733942912 00010000:00010000:2.0:1782216884.647212:0:8294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88e640031400/0xf210a9075089ea76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf210a9075089ea6f expref: 18 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216884.647217:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782216884.647230:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fff7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:526a4802-b871-4bcf-870f-067f11655366+5:8294:x1868789733942656:12345-0@lo:104: 00010000:00010000:2.0:1782216884.647236:0:8294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88e640031400/0xf210a9075089ea76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf210a9075089ea6f expref: 18 pid: 5776 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216884.647265:0:8294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67fff4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8294:1868789733943040:0@lo:104: 00010000:00010000:3.0:1782216884.647278:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.119@tcp lock: ffff88e640030400/0xf210a9075089eaa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089eaae expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216884.647339:0:8294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782216884.647360:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782216884.647368:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fff7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:526a4802-b871-4bcf-870f-067f11655366+5:8294:x1868789733942656:12345-0@lo:104: Request processed in 139us (8234us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216884.647376:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1782216884.647383:0:8294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88e67a2d3600/0xf210a9075089ea4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf210a9075089ea45 expref: 18 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216884.647393:0:8294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88e67a2d3600/0xf210a9075089ea4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf210a9075089ea45 expref: 18 pid: 5776 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216884.647403:0:8294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64846ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8294:1868789733943168:0@lo:104: 00000100:00100000:3.0:1782216884.647409:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733943040 00000100:00100000:3.0:1782216884.647413:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733943040 00000100:00100000:3.0:1782216884.647445:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782216884.647451:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fff7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:526a4802-b871-4bcf-870f-067f11655366+5:8294:x1868789733942784:12345-0@lo:104: 00010000:00010000:3.0:1782216884.647459:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.119@tcp lock: ffff88e641493c00/0xf210a9075089ea8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089ea92 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216884.647489:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1782216884.647493:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fff7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:526a4802-b871-4bcf-870f-067f11655366+5:8294:x1868789733942784:12345-0@lo:104: Request processed in 44us (8028us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216884.647498:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782216884.647510:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782216884.647515:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:526a4802-b871-4bcf-870f-067f11655366+4:8294:x1868789733942912:12345-0@lo:104: 00010000:00010000:3.0:1782216884.647522:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.119@tcp lock: ffff88e640031e00/0xf210a9075089ea7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089ea84 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216884.647531:0:8294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782216884.647553:0:8294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88e641492600/0xf210a9075089ea22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf210a9075089ea1b expref: 18 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216884.647569:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:2.0:1782216884.647574:0:8294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88e641492600/0xf210a9075089ea22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf210a9075089ea1b expref: 18 pid: 5775 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216884.647579:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:526a4802-b871-4bcf-870f-067f11655366+4:8294:x1868789733942912:12345-0@lo:104: Request processed in 61us (4259us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216884.647592:0:8294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648469f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8294:1868789733943296:0@lo:104: 00000100:00100000:3.0:1782216884.647593:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782216884.647608:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733943168 00000100:00100000:3.0:1782216884.647620:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733943168 00000100:00100000:2.0:1782216884.647624:0:8294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216884.647637:0:8294:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e679faacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782216884.647640:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733943296 00000100:00100000:3.0:1782216884.647644:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733943296 00000100:00100000:3.0:1782216884.647659:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782216884.647665:0:8294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67fff4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8294:1868789733942528:0@lo:104: 00000100:00100000:2.0:1782216884.647676:0:8294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67fff7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8294:1868789733942656:0@lo:104: 00000100:00100000:3.0:1782216884.647677:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:526a4802-b871-4bcf-870f-067f11655366+5:8294:x1868789733943040:12345-0@lo:104: 00000100:00100000:2.0:1782216884.647686:0:8294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67fff6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8294:1868789733942784:0@lo:104: 00010000:00010000:3.0:1782216884.647689:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2200/0xf210a9075089ea6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089ea76 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216884.647695:0:8294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67fff5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8294:1868789733942912:0@lo:104: 00010000:00010000:3.0:1782216884.647739:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1782216884.647747:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:526a4802-b871-4bcf-870f-067f11655366+5:8294:x1868789733943040:12345-0@lo:104: Request processed in 81us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216884.647755:0:8294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67fff4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8294:1868789733943040:0@lo:104: 00000100:00100000:3.0:1782216884.647756:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782216884.647776:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782216884.647782:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64846b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:526a4802-b871-4bcf-870f-067f11655366+4:8294:x1868789733943168:12345-0@lo:104: 00010000:00010000:3.0:1782216884.647790:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2600/0xf210a9075089ea45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089ea4c expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216884.647822:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00010000:00010000:3.0:1782216884.647830:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1782216884.647838:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648468a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:526a4802-b871-4bcf-870f-067f11655366+4:8294:x1868789733943296:12345-0@lo:104: 00000100:00100000:3.0:1782216884.647839:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64846b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:526a4802-b871-4bcf-870f-067f11655366+4:8294:x1868789733943168:12345-0@lo:104: Request processed in 55us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216884.647850:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1782216884.647851:0:6593:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3000/0xf210a9075089ea1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089ea22 expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.647913:0:6593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1782216884.647918:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648468a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:526a4802-b871-4bcf-870f-067f11655366+3:8294:x1868789733943296:12345-0@lo:104: Request processed in 88us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216884.647924:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:0.0:1782216884.647945:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1782216884.647952:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e641493600/0xf210a9075089ead1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089ead8 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.647970:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e641493600 already unused, calling callback (ffffffffc1d2fc20) 10000000:00010000:0.0:1782216884.647974:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e641493600/0xf210a9075089ead1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xf210a9075089ead8 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.647984:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e641493600/0xf210a9075089ead1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xf210a9075089ead8 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782216884.647992:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e641493600/0xf210a9075089ead1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xf210a9075089ead8 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216884.647999:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782216884.648044:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: ffff88e641493600/0xf210a9075089ead1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089ead8 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.648051:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782216884.648070:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e641493600/0xf210a9075089ead1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089ead8 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.648077:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e641493600/0xf210a9075089ead1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089ead8 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.648105:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1782216884.648108:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e640030400/0xf210a9075089eaa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089eaae expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.648113:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640030400 already unused, calling callback (ffffffffc1d2fc20) 10000000:00010000:0.0:1782216884.648116:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e640030400/0xf210a9075089eaa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xf210a9075089eaae expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.648132:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e640030400/0xf210a9075089eaa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xf210a9075089eaae expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782216884.648139:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e640030400/0xf210a9075089eaa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xf210a9075089eaae expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216884.648145:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782216884.648156:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: ffff88e640030400/0xf210a9075089eaa7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089eaae expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.648161:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782216884.648175:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e640030400/0xf210a9075089eaa7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089eaae expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.648181:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e640030400/0xf210a9075089eaa7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089eaae expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.648190:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1782216884.648193:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e641493c00/0xf210a9075089ea8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089ea92 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.648198:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e641493c00 already unused, calling callback (ffffffffc1d2fc20) 10000000:00010000:0.0:1782216884.648201:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e641493c00/0xf210a9075089ea8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf210a9075089ea92 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.648208:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e641493c00/0xf210a9075089ea8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf210a9075089ea92 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782216884.648214:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e641493c00/0xf210a9075089ea8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf210a9075089ea92 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216884.648223:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782216884.648235:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: ffff88e641493c00/0xf210a9075089ea8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089ea92 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.648240:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782216884.648245:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e641493c00/0xf210a9075089ea8b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089ea92 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.648264:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e641493c00/0xf210a9075089ea8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089ea92 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.648276:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1782216884.648279:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e640031e00/0xf210a9075089ea7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089ea84 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.648285:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640031e00 already unused, calling callback (ffffffffc1d2fc20) 10000000:00010000:0.0:1782216884.648287:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e640031e00/0xf210a9075089ea7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf210a9075089ea84 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.648293:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e640031e00/0xf210a9075089ea7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf210a9075089ea84 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782216884.648299:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e640031e00/0xf210a9075089ea7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf210a9075089ea84 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216884.648304:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782216884.648314:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: ffff88e640031e00/0xf210a9075089ea7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089ea84 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.648319:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782216884.648329:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e640031e00/0xf210a9075089ea7d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089ea84 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.648335:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e640031e00/0xf210a9075089ea7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089ea84 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.648344:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782216884.648347:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2200/0xf210a9075089ea6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089ea76 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.648352:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67a2d2200 already unused, calling callback (ffffffffc1d2fc20) 10000000:00010000:0.0:1782216884.648355:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2200/0xf210a9075089ea6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf210a9075089ea76 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.648362:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2200/0xf210a9075089ea6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf210a9075089ea76 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782216884.648367:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2200/0xf210a9075089ea6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf210a9075089ea76 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216884.648372:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782216884.648382:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2200/0xf210a9075089ea6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089ea76 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.648387:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782216884.648390:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2200/0xf210a9075089ea6f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089ea76 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.648396:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2200/0xf210a9075089ea6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089ea76 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.648404:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782216884.648412:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2600/0xf210a9075089ea45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089ea4c expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216884.648414:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:526a4802-b871-4bcf-870f-067f11655366:3301:1868789733943808:0@lo:103: 00000100:00100000:3.0:1782216884.648453:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216884.648485:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782216884.648492:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:526a4802-b871-4bcf-870f-067f11655366:3301:1868789733943424:0@lo:103: 00000100:00100000:3.0:1782216884.648515:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216884.648545:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:526a4802-b871-4bcf-870f-067f11655366:3301:1868789733943936:0@lo:103: 00000100:00100000:3.0:1782216884.648572:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216884.648609:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733943808 00000100:00100000:3.0:1782216884.648613:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733943808 00010000:00010000:0.0:1782216884.648623:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67a2d2600 already unused, calling callback (ffffffffc1d2fc20) 10000000:00010000:0.0:1782216884.648627:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2600/0xf210a9075089ea45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf210a9075089ea4c expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.648635:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2600/0xf210a9075089ea45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf210a9075089ea4c expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216884.648638:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88e67a2d3400/0xf210a9075089ea84 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089ea7d expref: 19 pid: 5778 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782216884.648649:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2600/0xf210a9075089ea45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf210a9075089ea4c expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216884.648657:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782216884.648690:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2600/0xf210a9075089ea45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089ea4c expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.648695:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782216884.648700:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2600/0xf210a9075089ea45 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089ea4c expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.648707:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2600/0xf210a9075089ea45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089ea4c expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.648716:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782216884.648719:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3000/0xf210a9075089ea1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089ea22 expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.648724:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67a2d3000 already unused, calling callback (ffffffffc1d2fc20) 10000000:00010000:0.0:1782216884.648727:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3000/0xf210a9075089ea1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf210a9075089ea22 expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.648743:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3000/0xf210a9075089ea1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf210a9075089ea22 expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782216884.648750:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3000/0xf210a9075089ea1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf210a9075089ea22 expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216884.648755:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782216884.648765:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3000/0xf210a9075089ea1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089ea22 expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.648770:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782216884.648773:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3000/0xf210a9075089ea1b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089ea22 expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.648779:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3000/0xf210a9075089ea1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089ea22 expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.648792:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216884.648794:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216884.648796:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216884.648812:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733943424 00000100:00100000:3.0:1782216884.648819:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733943424 00010000:00010000:3.0:1782216884.648838:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88e640030a00/0xf210a9075089ead8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089ead1 expref: 20 pid: 5775 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216884.648857:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733943936 00000100:00100000:3.0:1782216884.648861:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733943936 00000100:00100000:0.0:1782216884.648873:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00010000:00010000:3.0:1782216884.648903:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88e640031400/0xf210a9075089ea76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089ea6f expref: 21 pid: 5776 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216884.648919:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713997824 00000100:00100000:3.0:1782216884.648922:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713997824 00010000:00010000:3.0:1782216884.648937:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88e653161000/0xf210a9075089eaed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620139 expref: 10 pid: 5778 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216884.648953:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782216884.648960:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e644798050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:526a4802-b871-4bcf-870f-067f11655366+21:3301:x1868789733943808:12345-0@lo:103: 00010000:00010000:3.0:1782216884.648972:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782216884.648978:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88e67a2d3400/0xf210a9075089ea84 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089ea7d expref: 21 pid: 5778 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216884.648987:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00010000:00010000:3.0:1782216884.648994:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88e67a2d3400/0xf210a9075089ea84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf210a9075089ea7d expref: 21 pid: 5778 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216884.649008:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789733943552:0@lo:103: 00010000:00010000:3.0:1782216884.649012:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e67a2d3400/0xf210a9075089ea84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf210a9075089ea7d expref: 21 pid: 5778 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216884.649036:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216884.649052:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a805c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789733944064:0@lo:103: 00000100:00100000:0.0:1782216884.649067:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216884.649076:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782216884.649080:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789733943680:0@lo:103: 00000100:00100000:0.0:1782216884.649103:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216884.649110:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789733944192:0@lo:103: 00000100:00100000:0.0:1782216884.649124:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782216884.649160:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216884.649338:0:8294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67fff5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8294:1868789733942272:192.168.203.19@tcp:104: 00000100:00100000:2.0:1782216884.649347:0:8294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67fff5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8294:1868789733942400:192.168.203.19@tcp:104: 00000100:00100000:2.0:1782216884.649356:0:8294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64846ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8294:1868789733943168:0@lo:104: 00000100:00100000:2.0:1782216884.649363:0:8294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648469f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8294:1868789733943296:0@lo:104: 00010000:00010000:2.0:1782216884.649407:0:8294:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88e67a2d3800/0xf210a9075089eb25 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216884.649636:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782216884.649750:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e644798050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:526a4802-b871-4bcf-870f-067f11655366+20:3301:x1868789733943808:12345-0@lo:103: Request processed in 789us (1295us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216884.649757:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782216884.649806:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713997952 00000100:00100000:3.0:1782216884.649811:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713997952 00000100:00100000:0.0:1782216884.649815:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:526a4802-b871-4bcf-870f-067f11655366:3301:1868789733943808:0@lo:103: 00010000:00010000:3.0:1782216884.649833:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88e641493800/0xf210a9075089eae6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620132 expref: 11 pid: 5778 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216884.649849:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733943552 00000100:00100000:3.0:1782216884.649852:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733943552 00010000:00010000:3.0:1782216884.649863:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88e641493a00/0xf210a9075089eaae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089eaa7 expref: 20 pid: 5778 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216884.649872:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733944064 00000100:00100000:3.0:1782216884.649874:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733944064 00010000:00010000:3.0:1782216884.649918:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88e67a2d3600/0xf210a9075089ea4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089ea45 expref: 21 pid: 5776 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216884.649932:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733943680 00000100:00100000:3.0:1782216884.649935:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733943680 00000100:00100000:2.0:1782216884.649941:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733944192 00010000:00010000:3.0:1782216884.649946:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88e641492a00/0xf210a9075089ea92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089ea8b expref: 22 pid: 5775 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216884.649948:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733944192 00000100:00100000:3.0:1782216884.649965:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1782216884.649970:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88e641492600/0xf210a9075089ea22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089ea1b expref: 23 pid: 5775 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216884.649977:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a800a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:526a4802-b871-4bcf-870f-067f11655366+23:3301:x1868789733943424:12345-0@lo:103: 00010000:00010000:3.0:1782216884.649991:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1782216884.649993:0:5770:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:3.0:1782216884.649997:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88e640030a00/0xf210a9075089ead8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089ead1 expref: 23 pid: 5775 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216884.650004:0:5770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1782216884.650036:0:5768:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1782216884.650045:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782216884.650052:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a803800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:526a4802-b871-4bcf-870f-067f11655366+23:3301:x1868789733943936:12345-0@lo:103: 00010000:00010000:2.0:1782216884.650061:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782216884.650066:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88e640031400/0xf210a9075089ea76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089ea6f expref: 23 pid: 5776 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216884.650250:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88e640030a00/0xf210a9075089ead8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf210a9075089ead1 expref: 23 pid: 5775 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216884.650578:0:8299:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1782216884.650584:0:8299:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:0.0:1782216884.650792:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 15 00000100:00100000:0.0:1782216884.650805:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a807480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+11:2358:x1868789713997824:12345-192.168.203.19@tcp:103: 00010000:00010000:0.0:1782216884.650818:0:8299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782216884.650824:0:8299:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88e653161000/0xf210a9075089eaed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620139 expref: 11 pid: 5778 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216884.650936:0:8300:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 5 min 3 max 56 00000100:00100000:1.0:1782216884.650941:0:8300:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_005' 00010000:00010000:2.0:1782216884.652322:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88e640031400/0xf210a9075089ea76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf210a9075089ea6f expref: 23 pid: 5776 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216884.652422:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e640031400/0xf210a9075089ea76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf210a9075089ea6f expref: 23 pid: 5776 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216884.652720:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782216884.652974:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e640030a00/0xf210a9075089ead8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf210a9075089ead1 expref: 22 pid: 5775 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216884.652989:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782216884.653350:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a803800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:526a4802-b871-4bcf-870f-067f11655366+21:3301:x1868789733943936:12345-0@lo:103: Request processed in 3286us (4764us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216884.653363:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782216884.653410:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 16 00000100:00100000:2.0:1782216884.653425:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a807800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+11:2358:x1868789713997952:12345-192.168.203.19@tcp:103: 00010000:00010000:2.0:1782216884.653450:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782216884.653458:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88e641493800/0xf210a9075089eae6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620132 expref: 11 pid: 5778 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216884.653469:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88e641493800/0xf210a9075089eae6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620132 expref: 11 pid: 5778 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216884.653481:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e641493800/0xf210a9075089eae6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620132 expref: 11 pid: 5778 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216884.653531:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782216884.653604:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a807800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:2358:x1868789713997952:12345-192.168.203.19@tcp:103: Request processed in 184us (4619us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216884.653611:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 16 00000100:00100000:2.0:1782216884.653627:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782216884.653635:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a806d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:526a4802-b871-4bcf-870f-067f11655366+20:3303:x1868789733943552:12345-0@lo:103: 00010000:00010000:2.0:1782216884.653645:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782216884.653650:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88e641493a00/0xf210a9075089eaae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089eaa7 expref: 20 pid: 5778 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216884.653659:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88e641493a00/0xf210a9075089eaae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf210a9075089eaa7 expref: 20 pid: 5778 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216884.653670:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e641493a00/0xf210a9075089eaae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf210a9075089eaa7 expref: 20 pid: 5778 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216884.653681:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782216884.653713:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a806d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:526a4802-b871-4bcf-870f-067f11655366+19:3303:x1868789733943552:12345-0@lo:103: Request processed in 79us (4677us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216884.653719:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782216884.653731:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782216884.653737:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a807100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:526a4802-b871-4bcf-870f-067f11655366+18:3303:x1868789733944064:12345-0@lo:103: 00010000:00010000:2.0:1782216884.653745:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782216884.653750:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88e67a2d3600/0xf210a9075089ea4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089ea45 expref: 18 pid: 5776 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216884.653758:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88e67a2d3600/0xf210a9075089ea4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf210a9075089ea45 expref: 18 pid: 5776 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216884.653773:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e67a2d3600/0xf210a9075089ea4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf210a9075089ea45 expref: 18 pid: 5776 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216884.653783:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782216884.653804:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a807100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:526a4802-b871-4bcf-870f-067f11655366+17:3303:x1868789733944064:12345-0@lo:103: Request processed in 67us (4736us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216884.653810:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782216884.653822:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782216884.653828:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64479a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:526a4802-b871-4bcf-870f-067f11655366+16:3303:x1868789733943680:12345-0@lo:103: 00010000:00010000:2.0:1782216884.653836:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782216884.653841:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88e641492a00/0xf210a9075089ea92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089ea8b expref: 16 pid: 5775 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216884.653849:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88e641492a00/0xf210a9075089ea92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf210a9075089ea8b expref: 16 pid: 5775 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216884.653859:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e641492a00/0xf210a9075089ea92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf210a9075089ea8b expref: 16 pid: 5775 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216884.653868:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782216884.653907:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64479a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:526a4802-b871-4bcf-870f-067f11655366+15:3303:x1868789733943680:12345-0@lo:103: Request processed in 79us (4802us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216884.653913:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782216884.653925:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782216884.653931:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a805f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:526a4802-b871-4bcf-870f-067f11655366+14:3303:x1868789733944192:12345-0@lo:103: 00010000:00010000:2.0:1782216884.653938:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782216884.653943:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88e641492600/0xf210a9075089ea22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089ea1b expref: 14 pid: 5775 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216884.653956:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88e641492600/0xf210a9075089ea22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf210a9075089ea1b expref: 14 pid: 5775 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216884.653966:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e641492600/0xf210a9075089ea22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf210a9075089ea1b expref: 14 pid: 5775 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216884.653974:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782216884.654011:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a805f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:526a4802-b871-4bcf-870f-067f11655366+13:3303:x1868789733944192:12345-0@lo:103: Request processed in 80us (4885us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216884.654017:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782216884.654509:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789733943680:0@lo:103: 00000100:00100000:2.0:1782216884.654522:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789733944192:0@lo:103: 00000100:00100000:2.0:1782216884.654530:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789733943552:0@lo:103: 00000100:00100000:2.0:1782216884.654537:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a805c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789733944064:0@lo:103: 00010000:00010000:0.0:1782216884.656516:0:8299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88e653161000/0xf210a9075089eaed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620139 expref: 9 pid: 5778 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.656552:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e653161000/0xf210a9075089eaed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620139 expref: 9 pid: 5778 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.656576:0:8299:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88e67a2d3800/0xf210a9075089eb25 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.656586:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e67a2d3800/0xf210a9075089eb25 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.656639:0:8299:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88e67a2d3800/0xf210a9075089eb25 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.656647:0:8299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88e67a2d3800/0xf210a9075089eb25 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.656675:0:8299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88e67a2d3800/0xf210a9075089eb25 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.656683:0:8299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88e67a2d3800/0xf210a9075089eb25 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.656690:0:8299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67a2d3800 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:0.0:1782216884.656695:0:8299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88e67a2d3800/0xf210a9075089eb25 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.656705:0:8299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88e67a2d3800/0xf210a9075089eb25 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.656723:0:8299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88e67a2d3800/0xf210a9075089eb25 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216884.656739:0:8299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782216884.658065:0:8294:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88e67a2d3800/0xf210a9075089eb25 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216884.658093:0:8294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88e67a2d3800/0xf210a9075089eb25 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216884.658102:0:8294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e67a2d3800/0xf210a9075089eb25 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216884.658173:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a800a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:526a4802-b871-4bcf-870f-067f11655366+12:3301:x1868789733943424:12345-0@lo:103: Request processed in 8193us (9649us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216884.658187:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782216884.664132:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a807480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+8:2358:x1868789713997824:12345-192.168.203.19@tcp:103: Request processed in 13314us (15245us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216884.664149:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 15 00000100:00100000:1.0:1782216884.666383:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:526a4802-b871-4bcf-870f-067f11655366:3301:1868789733943936:0@lo:103: 00000100:00100000:1.0:1782216884.666417:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:526a4802-b871-4bcf-870f-067f11655366:3301:1868789733943424:0@lo:103: 00010000:00010000:3.0:1782216884.822340:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216885.205035:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782216885.205067:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733944320:0@lo:13: 00000100:00100000:2.0:1782216885.205153:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216885.207175:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733944320 00000100:00100000:1.0:1782216885.207193:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733944320 00000100:00100000:1.0:1782216885.207294:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782216885.207304:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648469f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733944320:12345-0@lo:13: 00002000:00000024:1.0:1782216885.207338:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1782216885.207422:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782216885.207576:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648469f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733944320:12345-0@lo:13: Request processed in 272us (2425us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216885.207587:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1782216885.207744:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67a807800 x1868789733944320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216901 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216885.207790:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733944320:0@lo:13: 00000100:00100000:0.0:1782216885.247954:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782216885.248000:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216885.248437:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713998080 00000100:00100000:3.0:1782216885.248450:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713998080 00000100:00100000:3.0:1782216885.248530:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 130 00000100:00100000:3.0:1782216885.248542:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e68044c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+8:2356:x1868789713998080:12345-192.168.203.19@tcp:400: 00000100:00100000:3.0:1782216885.248652:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e68044c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+8:2356:x1868789713998080:12345-192.168.203.19@tcp:400: Request processed in 111us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216885.248661:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 130 00000100:00100000:1.0:1782216885.249341:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713998208 00000100:00100000:1.0:1782216885.249349:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713998208 00000100:00100000:1.0:1782216885.249422:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 23 00000100:00100000:1.0:1782216885.249430:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2356:x1868789713998208:12345-192.168.203.19@tcp:400: 00000100:00100000:1.0:1782216885.249480:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2356:x1868789713998208:12345-192.168.203.19@tcp:400: Request processed in 51us (1478us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216885.249488:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 23 00000100:00080000:2.0:1782216885.250173:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782216885.253637:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216885.253690:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216885.253849:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713998464 00000100:00100000:1.0:1782216885.253861:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713998464 00000100:00100000:1.0:1782216885.253966:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713998336 00000100:00100000:1.0:1782216885.253970:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713998336 00000100:00100000:1.0:1782216885.253999:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 11 00000100:00100000:1.0:1782216885.254009:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2357:x1868789713998464:12345-192.168.203.19@tcp:400: 00000100:00100000:1.0:1782216885.254333:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2357:x1868789713998464:12345-192.168.203.19@tcp:400: Request processed in 323us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216885.254342:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 11 00000100:00100000:1.0:1782216885.254363:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 12 00000100:00100000:1.0:1782216885.254371:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2357:x1868789713998336:12345-192.168.203.19@tcp:400: 00000100:00100000:1.0:1782216885.254402:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2357:x1868789713998336:12345-192.168.203.19@tcp:400: Request processed in 33us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216885.254432:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 12 00000100:00080000:2.0:1782216885.254855:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782216885.254861:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782216885.844172:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782216886.356199:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782216886.356210:0:5780:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff88e64853e800 from 39 10000000:01000000:3.0:1782216886.356217:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782216886.356293:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e653161e00/0xf210a9075089eb2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216886.356306:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e653161e00/0xf210a9075089eb2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216886.356342:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e653161e00/0xf210a9075089eb2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216886.356373:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a803100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733944448:0@lo:101: 00000100:00100000:3.0:1782216886.356490:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216886.356565:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e65769cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1782216886.357573:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733944448 00000100:00100000:1.0:1782216886.357586:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733944448 00000100:00100000:1.0:1782216886.357660:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1782216886.357671:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e68044e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+12:5780:x1868789733944448:12345-0@lo:101: 00010000:00010000:1.0:1782216886.357702:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782216886.357727:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e67fd06000/0xf210a9075089eb33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089eb2c expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216886.357769:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e67fd06000/0xf210a9075089eb33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089eb2c expref: 13 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216886.357782:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e67fd06000/0xf210a9075089eb33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089eb2c expref: 13 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216886.357793:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd06000, rc 0) 00000100:00100000:1.0:1782216886.357909:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e68044e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+13:5780:x1868789733944448:12345-0@lo:101: Request processed in 238us (1419us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216886.357916:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1782216886.358274:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a803100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733944448:0@lo:101: 00010000:00010000:0.0:1782216886.358313:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e653161e00/0xf210a9075089eb2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089eb33 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216886.358324:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e653161e00/0xf210a9075089eb2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089eb33 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216886.358405:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a806d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733944576:0@lo:501: 00000100:00100000:0.0:1782216886.358467:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216886.358500:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64902e780 going to sleep for 11 seconds 00000100:00100000:2.0:1782216886.358711:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733944576 00000100:00100000:2.0:1782216886.358718:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733944576 00000100:00100000:2.0:1782216886.358763:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1782216886.358772:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e68044f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+14:5780:x1868789733944576:12345-0@lo:501: 00000100:00100000:2.0:1782216886.360831:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e68044f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+13:5780:x1868789733944576:12345-0@lo:501: Request processed in 2048us (2352us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216886.360846:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1782216886.362132:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a806d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733944576:0@lo:501: 00000100:00100000:3.0:1782216886.362227:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a801500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733944704:0@lo:503: 00000100:00100000:3.0:1782216886.362334:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216886.362390:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e65769c600 going to sleep for 11 seconds 00000100:00100000:0.0:1782216886.363054:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733944704 00000100:00100000:0.0:1782216886.363171:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733944704 00000100:00100000:0.0:1782216886.363265:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1782216886.363276:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e68044f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+13:5780:x1868789733944704:12345-0@lo:503: 00000100:00100000:0.0:1782216886.368601:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e68044f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+13:5780:x1868789733944704:12345-0@lo:503: Request processed in 5310us (6251us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216886.368623:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1782216886.368965:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a801500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733944704:0@lo:503: 00000100:00100000:3.0:1782216886.372874:0:8313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a801500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:8313:1868789733944832:0@lo:502: 00000100:00100000:3.0:1782216886.373663:0:8313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216886.375288:0:8313:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e65769cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1782216886.376633:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733944832 00000100:00100000:2.0:1782216886.376650:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733944832 00000100:00100000:2.0:1782216886.376740:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1782216886.376753:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e68044d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+13:8313:x1868789733944832:12345-0@lo:502: 00000100:00100000:2.0:1782216886.380624:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e68044d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+13:8313:x1868789733944832:12345-0@lo:502: Request processed in 3859us (6949us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216886.380643:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1782216886.382950:0:8313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a801500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:8313:1868789733944832:0@lo:502: 00000100:00100000:3.0:1782216886.383342:0:8313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a801500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:8313:1868789733944960:0@lo:502: 00000100:00100000:3.0:1782216886.384199:0:8313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216886.384278:0:8313:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e65769cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1782216886.384669:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733944960 00000100:00100000:0.0:1782216886.384680:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733944960 00000100:00100000:0.0:1782216886.385268:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1782216886.385280:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e68044cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+13:8313:x1868789733944960:12345-0@lo:502: 00000100:00100000:0.0:1782216886.387902:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e68044cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+13:8313:x1868789733944960:12345-0@lo:502: Request processed in 2584us (3666us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216886.387927:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1782216886.388558:0:8313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a801500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:8313:1868789733944960:0@lo:502: 00000040:00080000:3.0:1782216886.388612:0:8313:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1782216886.389980:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1782216886.390018:0:5780:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782216886.390042:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e653161e00/0xf210a9075089eb2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089eb33 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216886.390059:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e653161e00/0xf210a9075089eb2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089eb33 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782216886.390083:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1782216886.390108:0:5780:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1782216886.390112:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1782216886.390168:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67fd07800/0xf210a9075089eb3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216886.390177:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e67fd07800/0xf210a9075089eb3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216886.390190:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e67fd07800/0xf210a9075089eb3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216886.390221:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67426c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733945088:0@lo:101: 00000100:00100000:1.0:1782216886.390315:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216886.390384:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e680592b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782216886.392092:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733945088 00000100:00100000:2.0:1782216886.392109:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733945088 00000100:00100000:2.0:1782216886.392186:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1782216886.392198:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e68044c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+13:5780:x1868789733945088:12345-0@lo:101: 00010000:00010000:2.0:1782216886.392220:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216886.392251:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e67a2d3800/0xf210a9075089eb41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089eb3a expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216886.392288:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e67a2d3800/0xf210a9075089eb41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089eb3a expref: 14 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216886.392300:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e67a2d3800/0xf210a9075089eb41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089eb3a expref: 14 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216886.392318:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67a2d3800, rc 0) 00000100:00100000:2.0:1782216886.392411:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e68044c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+14:5780:x1868789733945088:12345-0@lo:101: Request processed in 214us (2095us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216886.392417:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1782216886.392807:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67426c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733945088:0@lo:101: 00010000:00010000:3.0:1782216886.392832:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e67fd07800/0xf210a9075089eb3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089eb41 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216886.392857:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e67fd07800/0xf210a9075089eb3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089eb41 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216886.393072:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a801500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733945216:0@lo:501: 00000100:00100000:3.0:1782216886.393128:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216886.393172:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e65769cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1782216886.393222:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733945216 00000100:00100000:1.0:1782216886.393229:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733945216 00000100:00100000:1.0:1782216886.394188:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1782216886.394204:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+14:5780:x1868789733945216:12345-0@lo:501: 00000100:00100000:1.0:1782216886.394591:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+14:5780:x1868789733945216:12345-0@lo:501: Request processed in 392us (1462us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216886.394599:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1782216886.394826:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a801500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733945216:0@lo:501: 00000100:00100000:3.0:1782216886.394903:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a801500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733945344:0@lo:503: 00000100:00100000:3.0:1782216886.394959:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216886.394993:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e65769cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1782216886.395765:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733945344 00000100:00100000:0.0:1782216886.395776:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733945344 00000100:00100000:0.0:1782216886.395834:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1782216886.395844:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+14:5780:x1868789733945344:12345-0@lo:503: 00000100:00100000:0.0:1782216886.396148:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+14:5780:x1868789733945344:12345-0@lo:503: Request processed in 304us (1187us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216886.396158:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1782216886.398905:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a801500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733945344:0@lo:503: 00000100:00100000:0.0:1782216886.400069:0:8314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a807100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:8314:1868789733945472:0@lo:502: 00000100:00100000:0.0:1782216886.400171:0:8314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216886.400219:0:8314:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6738e7180 going to sleep for 11 seconds 00000100:00100000:2.0:1782216886.400313:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733945472 00000100:00100000:2.0:1782216886.400322:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733945472 00000100:00100000:2.0:1782216886.400383:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1782216886.400393:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+14:8314:x1868789733945472:12345-0@lo:502: 00000100:00100000:2.0:1782216886.400669:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+14:8314:x1868789733945472:12345-0@lo:502: Request processed in 275us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216886.400677:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1782216886.400844:0:8314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a807100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:8314:1868789733945472:0@lo:502: 00000020:01000000:0.0:1782216886.400908:0:8314:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782216886.400919:0:8314:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782216886.400922:0:8314:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1782216886.400929:0:8314:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1782216886.400956:0:8314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a807100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:8314:1868789733945600:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782216886.401007:0:8314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216886.401021:0:8314:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e646046780 going to sleep for 11 seconds 00000100:00100000:2.0:1782216886.401234:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733945600 00000100:00100000:2.0:1782216886.401252:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733945600 00000100:00100000:2.0:1782216886.401293:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1782216886.401302:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+14:8314:x1868789733945600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782216886.401447:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+14:8314:x1868789733945600:12345-0@lo:502:llog_process_th.0 Request processed in 145us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216886.401455:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1782216886.401546:0:8314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a807100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:8314:1868789733945600:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782216886.401567:0:8314:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782216886.401572:0:8314:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782216886.401574:0:8314:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1782216886.401578:0:8314:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1782216886.402797:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1782216886.402831:0:5780:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1782216886.402848:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67fd07800/0xf210a9075089eb3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089eb41 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216886.402863:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e67fd07800/0xf210a9075089eb3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089eb41 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216886.402926:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782216886.402930:0:5780:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff88e673f4d000 from 39 10000000:01000000:2.0:1782216886.402933:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782216886.403086:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3600/0xf210a9075089eb48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216886.403095:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3600/0xf210a9075089eb48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216886.403106:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3600/0xf210a9075089eb48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216886.403132:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64846ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733945728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782216886.403200:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216886.403265:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e679faa0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782216886.403358:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733945728 00000100:00100000:1.0:1782216886.403366:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733945728 00000100:00100000:1.0:1782216886.403416:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1782216886.403426:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+14:5780:x1868789733945728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782216886.403441:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782216886.403458:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e67fd06800/0xf210a9075089eb4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089eb48 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216886.403487:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e67fd06800/0xf210a9075089eb4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089eb48 expref: 15 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216886.403508:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e67fd06800/0xf210a9075089eb4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089eb48 expref: 15 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216886.403518:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd06800, rc 0) 00000100:00100000:1.0:1782216886.403569:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+15:5780:x1868789733945728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216886.403577:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1782216886.403671:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64846ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733945728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782216886.403687:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3600/0xf210a9075089eb48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089eb4f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216886.403826:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3600/0xf210a9075089eb48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089eb4f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216886.404098:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64846ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733945856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782216886.404131:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216886.404204:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e679faa0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782216886.413677:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733945856 00000100:00100000:1.0:1782216886.413872:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733945856 00000100:00100000:1.0:1782216886.414046:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1782216886.414059:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+15:5780:x1868789733945856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782216886.414498:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+15:5780:x1868789733945856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 441us (10365us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216886.414508:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1782216886.414534:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64846ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733945856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782216886.414605:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a802a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733945984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782216886.414675:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216886.419853:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e65769c600 going to sleep for 11 seconds 00000100:00100000:2.0:1782216886.419957:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733945984 00000100:00100000:2.0:1782216886.420177:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733945984 00000100:00100000:2.0:1782216886.420264:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1782216886.420275:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+15:5780:x1868789733945984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782216886.420540:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+15:5780:x1868789733945984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 265us (5864us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216886.420549:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1782216886.420634:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a802a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733945984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782216886.421038:0:8315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648468380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:8315:1868789733946112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782216886.421090:0:8315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216886.421113:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733946112 00000100:00100000:2.0:1782216886.421118:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733946112 00000100:00100000:2.0:1782216886.421139:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1782216886.421145:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+15:8315:x1868789733946112:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782216886.421342:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+15:8315:x1868789733946112:12345-0@lo:502:llog_process_th.0 Request processed in 195us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216886.421349:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1782216886.421389:0:8315:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e679faa900 going to sleep for 11 seconds 00000100:00100000:2.0:1782216886.421402:0:8315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648468380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:8315:1868789733946112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782216886.421439:0:8315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648468380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:8315:1868789733946240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782216886.421470:0:8315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216886.421486:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733946240 00000100:00100000:2.0:1782216886.421489:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733946240 00000100:00100000:2.0:1782216886.421504:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1782216886.421509:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+15:8315:x1868789733946240:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782216886.421621:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+15:8315:x1868789733946240:12345-0@lo:502:llog_process_th.0 Request processed in 110us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216886.421634:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1782216886.421661:0:8315:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e679faa900 going to sleep for 11 seconds 00000100:00100000:2.0:1782216886.421671:0:8315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648468380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:8315:1868789733946240:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1782216886.421689:0:8315:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1782216886.424340:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1782216886.424384:0:5780:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782216886.424400:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3600/0xf210a9075089eb48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089eb4f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216886.424415:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3600/0xf210a9075089eb48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089eb4f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782216886.424429:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1782216886.424433:0:5780:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1782216886.424436:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1782216886.424516:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e653161400/0xf210a9075089eb56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216886.424525:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e653161400/0xf210a9075089eb56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216886.424540:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e653161400/0xf210a9075089eb56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216886.424570:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a802a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733946368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782216886.424669:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216886.424874:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e65769c600 going to sleep for 11 seconds 00000100:00100000:2.0:1782216886.425049:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733946368 00000100:00100000:2.0:1782216886.425058:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733946368 00000100:00100000:2.0:1782216886.425154:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1782216886.425165:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+15:5780:x1868789733946368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782216886.425180:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216886.425195:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e67a2d3200/0xf210a9075089eb5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089eb56 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216886.425223:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e67a2d3200/0xf210a9075089eb5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089eb56 expref: 16 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216886.425233:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e67a2d3200/0xf210a9075089eb5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089eb56 expref: 16 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216886.425256:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67a2d3200, rc 0) 00000100:00100000:2.0:1782216886.425311:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+16:5780:x1868789733946368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216886.425318:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1782216886.425395:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a802a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733946368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782216886.425411:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e653161400/0xf210a9075089eb56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089eb5d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216886.425420:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e653161400/0xf210a9075089eb56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089eb5d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216886.425475:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a802a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733946496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782216886.425501:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216886.433283:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e65769c600 going to sleep for 11 seconds 00000100:00100000:1.0:1782216886.437024:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733946496 00000100:00100000:1.0:1782216886.437045:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733946496 00000100:00100000:1.0:1782216886.437252:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1782216886.437264:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+16:5780:x1868789733946496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782216886.439994:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+16:5780:x1868789733946496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2718us (14478us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216886.440010:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1782216886.440170:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a802a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733946496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782216886.440252:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a802a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733946624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782216886.440310:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216886.440357:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e65769c600 going to sleep for 11 seconds 00000100:00100000:2.0:1782216886.440784:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733946624 00000100:00100000:2.0:1782216886.440793:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733946624 00000100:00100000:2.0:1782216886.440852:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1782216886.440862:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+16:5780:x1868789733946624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782216886.441107:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+16:5780:x1868789733946624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 244us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216886.441122:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1782216886.441180:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a802a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733946624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782216886.441848:0:8316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a802a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:8316:1868789733946752:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782216886.441937:0:8316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216886.441966:0:8316:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e65769c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782216886.442024:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733946752 00000100:00100000:1.0:1782216886.442031:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733946752 00000100:00100000:1.0:1782216886.442073:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1782216886.442082:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+16:8316:x1868789733946752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782216886.442333:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+16:8316:x1868789733946752:12345-0@lo:502:llog_process_th.0 Request processed in 252us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216886.442341:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1782216886.444853:0:8316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a802a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:8316:1868789733946752:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782216886.445806:0:8316:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782216886.445822:0:8316:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782216886.445825:0:8316:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1782216886.445834:0:8316:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1782216886.445901:0:8316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a802a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:8316:1868789733946880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782216886.446001:0:8316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216886.446052:0:8316:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e65769c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782216886.446094:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733946880 00000100:00100000:2.0:1782216886.446103:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733946880 00000100:00100000:2.0:1782216886.446166:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1782216886.446176:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+16:8316:x1868789733946880:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782216886.446448:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+16:8316:x1868789733946880:12345-0@lo:502:llog_process_th.0 Request processed in 272us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216886.446457:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1782216886.446482:0:8316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a802a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:8316:1868789733946880:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782216886.446840:0:8316:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782216886.446848:0:8316:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782216886.446850:0:8316:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1782216886.446855:0:8316:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1782216886.446977:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1782216886.446996:0:5780:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1782216886.447009:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e653161400/0xf210a9075089eb56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089eb5d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216886.447021:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e653161400/0xf210a9075089eb56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089eb5d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216886.447032:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782216886.447035:0:5780:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff88e650a2a800 from 39 10000000:01000000:2.0:1782216886.447038:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782216886.447073:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3e00/0xf210a9075089eb64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216886.447083:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3e00/0xf210a9075089eb64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216886.447093:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3e00/0xf210a9075089eb64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216886.447112:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648468380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733947008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782216886.447161:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216886.447195:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64902ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1782216886.447203:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733947008 00000100:00100000:1.0:1782216886.447209:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733947008 00000100:00100000:1.0:1782216886.447256:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1782216886.447265:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+16:5780:x1868789733947008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782216886.447278:0:5775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782216886.447294:0:5775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e67fd06a00/0xf210a9075089eb6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089eb64 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216886.447386:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e67fd06a00/0xf210a9075089eb6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089eb64 expref: 17 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216886.447400:0:5775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e67fd06a00/0xf210a9075089eb6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089eb64 expref: 17 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216886.447410:0:5775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd06a00, rc 0) 00000100:00100000:1.0:1782216886.447455:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+17:5780:x1868789733947008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216886.447461:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1782216886.447789:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648468380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733947008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782216886.447806:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3e00/0xf210a9075089eb64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089eb6b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216886.447816:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3e00/0xf210a9075089eb64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089eb6b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216886.447872:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648468380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733947136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782216886.447928:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216886.447946:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64902ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1782216886.448018:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733947136 00000100:00100000:0.0:1782216886.448024:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733947136 00000100:00100000:0.0:1782216886.448065:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1782216886.448073:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+17:5780:x1868789733947136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782216886.448480:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+17:5780:x1868789733947136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 406us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216886.448488:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1782216886.448548:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648468380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733947136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782216886.448582:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a802a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733947264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782216886.448624:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216886.448765:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e65769c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782216886.448794:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733947264 00000100:00100000:1.0:1782216886.448800:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733947264 00000100:00100000:1.0:1782216886.448860:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1782216886.448868:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+17:5780:x1868789733947264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782216886.449070:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+17:5780:x1868789733947264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 202us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216886.449087:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1782216886.449167:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a802a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733947264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782216886.449541:0:8317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64846aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:8317:1868789733947392:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782216886.449583:0:8317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216886.449805:0:8317:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64902ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1782216886.449830:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733947392 00000100:00100000:3.0:1782216886.449834:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733947392 00000100:00100000:1.0:1782216886.449905:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1782216886.449914:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+17:8317:x1868789733947392:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782216886.450106:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+17:8317:x1868789733947392:12345-0@lo:502:llog_process_th.0 Request processed in 192us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216886.450114:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1782216886.450190:0:8317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64846aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:8317:1868789733947392:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782216886.450230:0:8317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64846aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:8317:1868789733947520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782216886.450273:0:8317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216886.450490:0:8317:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e646214240 going to sleep for 11 seconds 00000100:00100000:0.0:1782216886.450517:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733947520 00000100:00100000:0.0:1782216886.450522:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733947520 00000100:00100000:0.0:1782216886.450547:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1782216886.450555:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+17:8317:x1868789733947520:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782216886.450797:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+17:8317:x1868789733947520:12345-0@lo:502:llog_process_th.0 Request processed in 241us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216886.450804:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1782216886.451048:0:8317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64846aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:8317:1868789733947520:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1782216886.451073:0:8317:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1782216886.451255:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1782216886.451280:0:5780:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782216886.451292:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3e00/0xf210a9075089eb64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089eb6b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216886.451304:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3e00/0xf210a9075089eb64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089eb6b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216886.451314:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1782216886.451317:0:5780:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1782216886.451321:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1782216886.451354:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67437a200/0xf210a9075089eb72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216886.451363:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e67437a200/0xf210a9075089eb72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216886.451373:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e67437a200/0xf210a9075089eb72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216886.451392:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a807100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733947648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782216886.451428:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216886.451469:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e646046180 going to sleep for 11 seconds 00000100:00100000:2.0:1782216886.451536:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733947648 00000100:00100000:2.0:1782216886.451541:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733947648 00000100:00100000:2.0:1782216886.451580:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1782216886.451594:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+17:5780:x1868789733947648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782216886.451605:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216886.451618:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e67a2d2c00/0xf210a9075089eb79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089eb72 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216886.451642:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e67a2d2c00/0xf210a9075089eb79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089eb72 expref: 18 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216886.451654:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e67a2d2c00/0xf210a9075089eb79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089eb72 expref: 18 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216886.451663:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67a2d2c00, rc 0) 00000100:00100000:2.0:1782216886.451711:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+18:5780:x1868789733947648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216886.451717:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1782216886.451836:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a807100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733947648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782216886.451851:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e67437a200/0xf210a9075089eb72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089eb79 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216886.451860:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e67437a200/0xf210a9075089eb72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089eb79 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216886.451934:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a807100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733947776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782216886.451963:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216886.451978:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e646046180 going to sleep for 11 seconds 00000100:00100000:3.0:1782216886.452059:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733947776 00000100:00100000:3.0:1782216886.452064:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733947776 00000100:00100000:3.0:1782216886.452085:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1782216886.452092:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+18:5780:x1868789733947776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782216886.452386:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+18:5780:x1868789733947776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 294us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216886.452394:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1782216886.452470:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a807100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733947776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782216886.452502:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a807100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733947904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782216886.452542:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216886.452569:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e646046180 going to sleep for 11 seconds 00000100:00100000:1.0:1782216886.452630:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733947904 00000100:00100000:1.0:1782216886.452635:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733947904 00000100:00100000:0.0:1782216886.452789:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1782216886.452796:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+18:5780:x1868789733947904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782216886.452988:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+18:5780:x1868789733947904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 191us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216886.452995:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1782216886.453085:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a807100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733947904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782216886.453562:0:8318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67426d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:8318:1868789733948032:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782216886.453609:0:8318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216886.453643:0:8318:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e67f6de900 going to sleep for 11 seconds 00000100:00100000:3.0:1782216886.453775:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733948032 00000100:00100000:3.0:1782216886.453781:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733948032 00000100:00100000:3.0:1782216886.453819:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1782216886.453827:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+18:8318:x1868789733948032:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782216886.454056:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+18:8318:x1868789733948032:12345-0@lo:502:llog_process_th.0 Request processed in 229us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216886.454063:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1782216886.454180:0:8318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67426d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:8318:1868789733948032:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782216886.454206:0:8318:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782216886.454216:0:8318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216886.454219:0:8318:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1782216886.454225:0:8318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1782216886.454259:0:8318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67426d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:8318:1868789733948160:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782216886.454292:0:8318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216886.454322:0:8318:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e67f6de900 going to sleep for 11 seconds 00000100:00100000:2.0:1782216886.454382:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733948160 00000100:00100000:2.0:1782216886.454387:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733948160 00000100:00100000:2.0:1782216886.454419:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1782216886.454425:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+18:8318:x1868789733948160:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782216886.454565:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+18:8318:x1868789733948160:12345-0@lo:502:llog_process_th.0 Request processed in 140us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216886.454572:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1782216886.454672:0:8318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67426d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:8318:1868789733948160:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782216886.454689:0:8318:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782216886.454758:0:8318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216886.454761:0:8318:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1782216886.454765:0:8318:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1782216886.454979:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1782216886.454999:0:5780:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1782216886.455012:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67437a200/0xf210a9075089eb72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089eb79 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216886.455024:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e67437a200/0xf210a9075089eb72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089eb79 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216886.455044:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1782216886.455047:0:5780:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff88e6484dcd40 from 1 10000000:01000000:0.0:1782216886.455050:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1782216886.455080:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67437b400/0xf210a9075089eb80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216886.455089:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e67437b400/0xf210a9075089eb80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216886.455100:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e67437b400/0xf210a9075089eb80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216886.455116:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a807480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733948288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782216886.455147:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216886.455181:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e646046480 going to sleep for 11 seconds 00000100:00100000:3.0:1782216886.455314:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733948288 00000100:00100000:3.0:1782216886.455320:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733948288 00000100:00100000:3.0:1782216886.455346:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1782216886.455354:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+18:5780:x1868789733948288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782216886.455365:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782216886.455379:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e653161000/0xf210a9075089eb87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089eb80 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216886.455404:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e653161000/0xf210a9075089eb87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089eb80 expref: 19 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216886.455414:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e653161000/0xf210a9075089eb87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089eb80 expref: 19 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216886.455423:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e653161000, rc 0) 00000100:00100000:3.0:1782216886.455465:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+19:5780:x1868789733948288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216886.455480:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1782216886.455571:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a807480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733948288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782216886.455586:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e67437b400/0xf210a9075089eb80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089eb87 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216886.455595:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e67437b400/0xf210a9075089eb80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089eb87 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216886.455656:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64846aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733948416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782216886.455684:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216886.455774:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e65081f780 going to sleep for 11 seconds 00000100:00100000:0.0:1782216886.455821:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733948416 00000100:00100000:0.0:1782216886.455825:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733948416 00000100:00100000:0.0:1782216886.455855:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1782216886.455863:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+19:5780:x1868789733948416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782216886.456148:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+19:5780:x1868789733948416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 285us (462us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782216886.456155:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1782216886.456322:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64846aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733948416:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1782216886.456349:0:5780:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1782216886.456356:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67437b400/0xf210a9075089eb80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089eb87 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216886.456366:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e67437b400/0xf210a9075089eb80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089eb87 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216886.870444:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782216887.253462:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67426d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868789733948672:0@lo:400:kworker.0 00000100:00100000:0.0:1782216887.253557:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67426d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:526a4802-b871-4bcf-870f-067f11655366:3302:1868789733948544:0@lo:400:kworker.0 00000100:00100000:0.0:1782216887.253647:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216887.253701:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67426ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1868789733949056:0@lo:400:kworker.0 00000100:00100000:0.0:1782216887.253731:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216887.253786:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782216887.253793:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67426e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1868789733948928:0@lo:400:kworker.0 00000100:00100000:0.0:1782216887.253817:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216887.253849:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733949056 00000100:00100000:0.0:1782216887.253858:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733949056 00000100:00100000:0.0:1782216887.253947:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733948928 00000100:00100000:0.0:1782216887.253951:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733948928 00000100:00100000:0.0:1782216887.253976:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782216887.253986:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1868789733949056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216887.254048:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1868789733949056:12345-0@lo:400:kworker.0 Request processed in 63us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216887.254057:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782216887.254076:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782216887.254083:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1868789733948928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216887.254110:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1868789733948928:12345-0@lo:400:kworker.0 Request processed in 28us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216887.254116:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1782216887.254134:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782216887.254171:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67426e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1868789733948928:0@lo:400:kworker.0 00000100:00100000:0.0:1782216887.254182:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67426ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1868789733949056:0@lo:400:kworker.0 00000100:00100000:0.0:1782216887.254209:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733948544 00000100:00100000:0.0:1782216887.254212:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733948544 00000100:00100000:0.0:1782216887.254249:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1782216887.254256:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+19:3302:x1868789733948544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216887.254292:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+19:3302:x1868789733948544:12345-0@lo:400:kworker.0 Request processed in 37us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216887.254309:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1782216887.254338:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67426d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:526a4802-b871-4bcf-870f-067f11655366:3302:1868789733948544:0@lo:400:kworker.0 00000100:00100000:0.0:1782216887.254385:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67426e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733948800:0@lo:400:kworker.0 00000100:00100000:0.0:1782216887.254415:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216887.254479:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733948800 00000100:00100000:0.0:1782216887.254483:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733948800 00000100:00100000:0.0:1782216887.254516:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782216887.254522:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a806a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733948800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216887.254557:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a806a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733948800:12345-0@lo:400:kworker.0 Request processed in 35us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216887.254563:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1782216887.254583:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782216887.254607:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67426e680 x1868789733948800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216887.254627:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67426e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733948800:0@lo:400:kworker.0 00000100:00100000:1.0:1782216887.254835:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216887.254871:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67426fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733949184:0@lo:400:kworker.0 00000100:00100000:1.0:1782216887.254909:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216887.254947:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733949184 00000100:00100000:1.0:1782216887.254951:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733949184 00000100:00100000:1.0:1782216887.254986:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782216887.254993:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67426d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733949184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216887.255035:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67426d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733949184:12345-0@lo:400:kworker.0 Request processed in 43us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216887.255043:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1782216887.255072:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67426fb80 x1868789733949184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216887.255084:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67426fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733949184:0@lo:400:kworker.0 00000100:00080000:2.0:1782216887.255177:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782216887.255732:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733948672 00000100:00100000:2.0:1782216887.255739:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733948672 00000100:00100000:2.0:1782216887.255794:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782216887.255802:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67426c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868789733948672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216887.255853:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67426c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868789733948672:12345-0@lo:400:kworker.0 Request processed in 52us (1185us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216887.255860:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782216887.255913:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67426d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868789733948672:0@lo:400:kworker.0 00000100:00100000:0.0:1782216887.764171:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67426d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733949312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782216887.764250:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216887.766974:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733949312 00000100:00100000:1.0:1782216887.766988:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733949312 00000100:00100000:1.0:1782216887.769113:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782216887.769133:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a805500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733949312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782216887.769172:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782216887.769282:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a805500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733949312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 147us (5021us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216887.769290:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1782216887.769753:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67426d180 x1868789733949312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216887.769775:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67426d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733949312:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782216887.893106:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216888.916381:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216889.941198:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782216890.324134:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782216890.324156:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a805180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733949440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782216890.324251:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216890.324492:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733949440 00000100:00100000:0.0:1782216890.324501:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733949440 00000100:00100000:0.0:1782216890.324573:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782216890.324583:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67426fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733949440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782216890.324619:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782216890.324675:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67426fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733949440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216890.324682:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1782216890.324764:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67a805180 x1868789733949440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216906 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216890.324782:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a805180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733949440:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782216890.324836:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782216890.371470:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782216890.371515:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782216890.371549:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782216890.371591:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782216890.371623:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713998848 00000100:00100000:0.0:1782216890.371632:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713998848 00000100:00100000:0.0:1782216890.371690:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713998976 00000100:00100000:0.0:1782216890.371693:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713998976 00000100:00100000:0.0:1782216890.371718:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 15 00000100:00100000:0.0:1782216890.371728:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2358:x1868789713998848:12345-192.168.203.19@tcp:400: 00000100:00100000:0.0:1782216890.371798:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2358:x1868789713998848:12345-192.168.203.19@tcp:400: Request processed in 71us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216890.371806:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 15 00000100:00100000:0.0:1782216890.371822:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 16 00000100:00100000:0.0:1782216890.371829:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2358:x1868789713998976:12345-192.168.203.19@tcp:400: 00000100:00100000:0.0:1782216890.371854:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2358:x1868789713998976:12345-192.168.203.19@tcp:400: Request processed in 26us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216890.371861:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 16 00000100:00100000:3.0:1782216890.371937:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713998592 00000100:00100000:3.0:1782216890.371950:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713998592 00000100:00080000:0.0:1782216890.372026:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782216890.372031:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782216890.372048:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 164 00000100:00100000:0.0:1782216890.372071:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+8:2358:x1868789713998592:12345-192.168.203.19@tcp:400: 00000100:00100000:0.0:1782216890.372105:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+8:2358:x1868789713998592:12345-192.168.203.19@tcp:400: Request processed in 36us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216890.372112:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 164 00000100:00100000:2.0:1782216890.372232:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713998720 00000100:00100000:2.0:1782216890.372238:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713998720 00000100:00100000:2.0:1782216890.372297:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 27 00000100:00100000:2.0:1782216890.372305:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2358:x1868789713998720:12345-192.168.203.19@tcp:400: 00000100:00100000:2.0:1782216890.372342:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2358:x1868789713998720:12345-192.168.203.19@tcp:400: Request processed in 37us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216890.372356:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 27 00000100:00080000:0.0:1782216890.372541:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782216890.879149:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216890.882217:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713999104 00000100:00100000:1.0:1782216890.882230:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713999104 00000100:00100000:1.0:1782216890.882298:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 165 00000100:00100000:1.0:1782216890.882309:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+8:5572:x1868789713999104:12345-192.168.203.19@tcp:101: 00010000:00010000:1.0:1782216890.882326:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782216890.882342:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e67fd06e00/0xf210a9075089eb8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62019b expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216890.882372:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e67fd06e00/0xf210a9075089eb8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62019b expref: 9 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216890.882383:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e67fd06e00/0xf210a9075089eb8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62019b expref: 9 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216890.882392:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd06e00, rc 0) 00000100:00100000:1.0:1782216890.882459:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+9:5572:x1868789713999104:12345-192.168.203.19@tcp:101: Request processed in 153us (3318us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216890.882467:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 165 00000100:00100000:3.0:1782216890.885385:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216890.885804:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713999232 00000100:00100000:2.0:1782216890.885813:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713999232 00000100:00100000:2.0:1782216890.885873:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 166 00000100:00100000:2.0:1782216890.885908:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+9:5572:x1868789713999232:12345-192.168.203.19@tcp:501: 00000100:00100000:2.0:1782216890.886205:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+9:5572:x1868789713999232:12345-192.168.203.19@tcp:501: Request processed in 298us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216890.886224:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 166 00000100:00100000:3.0:1782216890.891650:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782216890.891833:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713999360 00000100:00100000:0.0:1782216890.891843:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713999360 00000100:00100000:0.0:1782216890.891922:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 167 00000100:00100000:0.0:1782216890.891933:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+9:5572:x1868789713999360:12345-192.168.203.19@tcp:503: 00000100:00100000:0.0:1782216890.892162:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+9:5572:x1868789713999360:12345-192.168.203.19@tcp:503: Request processed in 230us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216890.892170:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 167 00000100:00100000:0.0:1782216890.902925:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216890.903845:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713999488 00000100:00100000:1.0:1782216890.903856:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713999488 00000100:00100000:1.0:1782216890.903945:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 168 00000100:00100000:1.0:1782216890.903955:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+9:6067:x1868789713999488:12345-192.168.203.19@tcp:502: 00000100:00100000:1.0:1782216890.904237:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+9:6067:x1868789713999488:12345-192.168.203.19@tcp:502: Request processed in 282us (1320us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216890.904253:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 168 00000100:00100000:3.0:1782216890.909319:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216890.913488:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713999616 00000100:00100000:2.0:1782216890.913503:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713999616 00000100:00100000:2.0:1782216890.913573:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 169 00000100:00100000:2.0:1782216890.913583:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+9:6067:x1868789713999616:12345-192.168.203.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782216890.914364:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+9:6067:x1868789713999616:12345-192.168.203.19@tcp:502:llog_process_th.0 Request processed in 777us (5050us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216890.914375:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 169 00000100:00100000:1.0:1782216890.928114:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782216890.928375:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713999744 00000100:00100000:0.0:1782216890.928385:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713999744 00000100:00100000:0.0:1782216890.928441:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 170 00000100:00100000:0.0:1782216890.928452:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+9:5572:x1868789713999744:12345-192.168.203.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782216890.928469:0:5775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216890.928486:0:5775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e67437be00/0xf210a9075089eb95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6201a2 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216890.928515:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e67437be00/0xf210a9075089eb95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6201a2 expref: 10 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216890.928527:0:5775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e67437be00/0xf210a9075089eb95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6201a2 expref: 10 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216890.928553:0:5775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437be00, rc 0) 00000100:00100000:0.0:1782216890.928609:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:5572:x1868789713999744:12345-192.168.203.19@tcp:101:ll_cfg_requeue.0 Request processed in 159us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216890.928616:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 170 00000100:00100000:0.0:1782216890.931262:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216890.931357:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713999872 00000100:00100000:2.0:1782216890.931366:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713999872 00000100:00100000:2.0:1782216890.931415:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 171 00000100:00100000:2.0:1782216890.931425:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:5572:x1868789713999872:12345-192.168.203.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782216890.931772:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:5572:x1868789713999872:12345-192.168.203.19@tcp:501:ll_cfg_requeue.0 Request processed in 347us (517us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782216890.931781:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 171 00010000:00010000:3.0:1782216890.971944:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216891.988229:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782216892.181700:0:8358:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc0d2e7b40 20000000:00000080:2.0:1782216892.181718:0:8358:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88e67a616800 uarg=0000000000000000 20000000:01000000:2.0:1782216892.181756:0:8358:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1782216892.181762:0:8358:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1782216892.181766:0:8358:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1782216892.182750:0:8359:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1782216892.183086:0:8358:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1782216892.191812:0:8358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1782216892.192139:0:8358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1782216892.192221:0:8358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1782216892.192238:0:8358:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1782216892.192257:0:8358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88e67a2d3a00/0xf210a9075089eb9c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216892.192274:0:8358:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88e641492000/0xf210a9075089e96c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089e965 expref: 18 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216892.192282:0:8358:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88e640031200/0xf210a9075089e9b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089e9ab expref: 18 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216892.192288:0:8358:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88e641493000/0xf210a9075089ea3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089ea37 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216892.192297:0:8358:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88e67fd07a00/0xf210a9075089eafb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62016a expref: 9 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216892.192304:0:8358:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88e67a2d3a00/0xf210a9075089eb9c lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216892.192340:0:8358:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88e67fd07a00/0xf210a9075089eafb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62016a expref: 9 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216892.192355:0:8358:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88e67fd07a00/0xf210a9075089eafb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62016a expref: 9 pid: 5775 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216892.192386:0:8358:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64846aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8358:1868789733949568:192.168.203.19@tcp:104: 00010000:00010000:2.0:1782216892.192504:0:8358:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88e641493000/0xf210a9075089ea3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf210a9075089ea37 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216892.192512:0:8358:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88e641493000/0xf210a9075089ea3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf210a9075089ea37 expref: 18 pid: 5778 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216892.192521:0:8358:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648469500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8358:1868789733949696:0@lo:104: 00000100:00100000:2.0:1782216892.192564:0:8358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782216892.192603:0:8358:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88e640031200/0xf210a9075089e9b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf210a9075089e9ab expref: 18 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216892.192611:0:8358:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88e640031200/0xf210a9075089e9b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf210a9075089e9ab expref: 18 pid: 5775 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216892.192620:0:8358:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648469180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8358:1868789733949824:0@lo:104: 00010000:00010000:2.0:1782216892.192641:0:8358:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88e641492000/0xf210a9075089e96c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf210a9075089e965 expref: 18 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216892.192648:0:8358:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88e641492000/0xf210a9075089e96c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf210a9075089e965 expref: 18 pid: 5776 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216892.192655:0:8358:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64846a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8358:1868789733949952:0@lo:104: 00000100:00100000:2.0:1782216892.192671:0:8358:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64902e480 going to sleep for 11 seconds 00000100:00100000:0.0:1782216892.193693:0:6593:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782216892.193734:0:6593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216892.193758:0:6593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216892.193780:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733949696 00000100:00100000:0.0:1782216892.193788:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733949696 00000100:00100000:0.0:1782216892.193824:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733949824 00000100:00100000:0.0:1782216892.193827:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733949824 00000100:00100000:0.0:1782216892.193837:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733949952 00000100:00100000:0.0:1782216892.193839:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733949952 00000100:00100000:0.0:1782216892.193853:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782216892.193861:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f068450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:526a4802-b871-4bcf-870f-067f11655366+5:8358:x1868789733949696:12345-0@lo:104: 00010000:00010000:0.0:1782216892.193896:0:6593:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.119@tcp lock: ffff88e653160e00/0xf210a9075089ea37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089ea3e expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216892.193951:0:6593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782216892.193957:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f068450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:526a4802-b871-4bcf-870f-067f11655366+5:8358:x1868789733949696:12345-0@lo:104: Request processed in 97us (1392us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216892.193965:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782216892.194002:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782216892.194009:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a807b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:526a4802-b871-4bcf-870f-067f11655366+4:8358:x1868789733949824:12345-0@lo:104: 00010000:00010000:0.0:1782216892.194016:0:6593:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.119@tcp lock: ffff88e640031600/0xf210a9075089e9ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089e9b2 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216892.194064:0:6593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1782216892.194070:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a807b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:526a4802-b871-4bcf-870f-067f11655366+4:8358:x1868789733949824:12345-0@lo:104: Request processed in 62us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216892.194076:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782216892.194089:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782216892.194095:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a804700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:526a4802-b871-4bcf-870f-067f11655366+3:8358:x1868789733949952:12345-0@lo:104: 00010000:00010000:0.0:1782216892.194102:0:6593:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.119@tcp lock: ffff88e682171e00/0xf210a9075089e965 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089e96c expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216892.194127:0:6593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1782216892.194132:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a804700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:526a4802-b871-4bcf-870f-067f11655366+3:8358:x1868789733949952:12345-0@lo:104: Request processed in 38us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216892.194138:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1782216892.194155:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782216892.194161:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e653160e00/0xf210a9075089ea37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089ea3e expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216892.194168:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e653160e00 already unused, calling callback (ffffffffc1d2fc20) 10000000:00010000:0.0:1782216892.194183:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e653160e00/0xf210a9075089ea37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf210a9075089ea3e expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216892.194193:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e653160e00/0xf210a9075089ea37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf210a9075089ea3e expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782216892.194211:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e653160e00/0xf210a9075089ea37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf210a9075089ea3e expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216892.194218:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782216892.194253:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: ffff88e653160e00/0xf210a9075089ea37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089ea3e expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216892.194261:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782216892.194279:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e653160e00/0xf210a9075089ea37 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089ea3e expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216892.194287:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e653160e00/0xf210a9075089ea37 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089ea3e expref: -99 pid: 7470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216892.194300:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782216892.194303:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e640031600/0xf210a9075089e9ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089e9b2 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216892.194309:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640031600 already unused, calling callback (ffffffffc1d2fc20) 10000000:00010000:0.0:1782216892.194312:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e640031600/0xf210a9075089e9ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf210a9075089e9b2 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216892.194319:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e640031600/0xf210a9075089e9ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf210a9075089e9b2 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782216892.194326:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e640031600/0xf210a9075089e9ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf210a9075089e9b2 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216892.194332:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782216892.194344:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: ffff88e640031600/0xf210a9075089e9ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e9b2 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216892.194350:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782216892.194364:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e640031600/0xf210a9075089e9ab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e9b2 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216892.194381:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e640031600/0xf210a9075089e9ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e9b2 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216892.194391:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782216892.194394:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e682171e00/0xf210a9075089e965 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089e96c expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216892.194400:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e682171e00 already unused, calling callback (ffffffffc1d2fc20) 10000000:00010000:0.0:1782216892.194403:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e682171e00/0xf210a9075089e965 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf210a9075089e96c expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216892.194410:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e682171e00/0xf210a9075089e965 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf210a9075089e96c expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782216892.194417:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e682171e00/0xf210a9075089e965 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf210a9075089e96c expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216892.194422:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782216892.194436:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: ffff88e682171e00/0xf210a9075089e965 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e96c expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216892.194442:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782216892.194448:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e682171e00/0xf210a9075089e965 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e96c expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216892.194455:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e682171e00/0xf210a9075089e965 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089e96c expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216892.194468:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216892.194475:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216892.194476:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216892.194483:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216892.194516:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:526a4802-b871-4bcf-870f-067f11655366:3302:1868789733950080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782216892.194548:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216892.194591:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a805180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789733950208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782216892.194612:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216892.194630:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782216892.194636:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789733950336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782216892.194655:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216892.194680:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733950080 00000100:00100000:0.0:1782216892.194685:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733950080 00010000:00010000:0.0:1782216892.194704:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88e641493000/0xf210a9075089ea3e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089ea37 expref: 19 pid: 5778 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216892.194723:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733950208 00000100:00100000:0.0:1782216892.194726:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733950208 00010000:00010000:0.0:1782216892.194737:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88e640031200/0xf210a9075089e9b2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089e9ab expref: 20 pid: 5775 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216892.194749:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733950336 00000100:00100000:0.0:1782216892.194752:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733950336 00010000:00010000:0.0:1782216892.194763:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88e641492000/0xf210a9075089e96c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089e965 expref: 21 pid: 5776 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216892.194779:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782216892.194785:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a807100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:526a4802-b871-4bcf-870f-067f11655366+21:3302:x1868789733950080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782216892.194796:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782216892.194801:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88e641493000/0xf210a9075089ea3e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089ea37 expref: 21 pid: 5778 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216892.194817:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88e641493000/0xf210a9075089ea3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf210a9075089ea37 expref: 21 pid: 5778 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216892.194832:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782216892.194858:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a807100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:526a4802-b871-4bcf-870f-067f11655366+21:3302:x1868789733950080:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216892.194865:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782216892.194908:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782216892.194915:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a806d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:526a4802-b871-4bcf-870f-067f11655366+20:3303:x1868789733950208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782216892.194923:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782216892.194927:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88e640031200/0xf210a9075089e9b2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089e9ab expref: 20 pid: 5775 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216892.194936:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88e640031200/0xf210a9075089e9b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf210a9075089e9ab expref: 20 pid: 5775 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216892.194945:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782216892.194970:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a806d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:526a4802-b871-4bcf-870f-067f11655366+20:3303:x1868789733950208:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216892.194977:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782216892.194990:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782216892.194996:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a805c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:526a4802-b871-4bcf-870f-067f11655366+19:3303:x1868789733950336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782216892.195003:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782216892.195007:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88e641492000/0xf210a9075089e96c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089e965 expref: 19 pid: 5776 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216892.195016:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88e641492000/0xf210a9075089e96c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf210a9075089e965 expref: 19 pid: 5776 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216892.195031:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782216892.195050:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a805c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:526a4802-b871-4bcf-870f-067f11655366+19:3303:x1868789733950336:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216892.195057:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782216892.195099:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:526a4802-b871-4bcf-870f-067f11655366:3302:1868789733950080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782216892.195129:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789733950336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782216892.195137:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a805180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789733950208:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782216892.195679:0:8358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e641493000/0xf210a9075089ea3e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf210a9075089ea37 expref: 18 pid: 5778 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216892.195717:0:8358:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648469500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8358:1868789733949696:0@lo:104: 00010000:00010000:2.0:1782216892.195738:0:8358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e640031200/0xf210a9075089e9b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf210a9075089e9ab expref: 17 pid: 5775 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216892.195748:0:8358:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648469180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8358:1868789733949824:0@lo:104: 00010000:00010000:2.0:1782216892.195758:0:8358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e641492000/0xf210a9075089e96c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf210a9075089e965 expref: 16 pid: 5776 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216892.195766:0:8358:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64846a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8358:1868789733949952:0@lo:104: 00000100:00100000:1.0:1782216892.198994:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782216892.199067:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714000000 00000100:00100000:0.0:1782216892.199076:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714000000 00010000:00010000:0.0:1782216892.199115:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88e67fd07a00/0xf210a9075089eafb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62016a expref: 10 pid: 5775 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216892.199156:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 24 00000100:00100000:0.0:1782216892.199167:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67426dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:2358:x1868789714000000:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782216892.199184:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782216892.199191:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88e67fd07a00/0xf210a9075089eafb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62016a expref: 10 pid: 5775 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216892.199214:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88e67fd07a00/0xf210a9075089eafb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62016a expref: 10 pid: 5775 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216892.199236:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88e67a2d3a00/0xf210a9075089eb9c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216892.199243:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e67a2d3a00/0xf210a9075089eb9c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216892.199274:0:5768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88e67a2d3a00/0xf210a9075089eb9c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216892.199281:0:5768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88e67a2d3a00/0xf210a9075089eb9c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216892.199286:0:5768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88e67a2d3a00/0xf210a9075089eb9c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216892.199292:0:5768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88e67a2d3a00/0xf210a9075089eb9c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216892.199298:0:5768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67a2d3a00 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:0.0:1782216892.199302:0:5768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88e67a2d3a00/0xf210a9075089eb9c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216892.199311:0:5768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88e67a2d3a00/0xf210a9075089eb9c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216892.199319:0:5768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88e67a2d3a00/0xf210a9075089eb9c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216892.199328:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782216892.199381:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67426dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:2358:x1868789714000000:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 216us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216892.199389:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 24 00010000:00010000:2.0:1782216892.200611:0:8358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e67fd07a00/0xf210a9075089eafb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62016a expref: 9 pid: 5775 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216892.200632:0:8358:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64846aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8358:1868789733949568:192.168.203.19@tcp:104: 00010000:00010000:2.0:1782216892.200661:0:8358:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88e67a2d3a00/0xf210a9075089eb9c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216892.200672:0:8358:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88e67a2d3a00/0xf210a9075089eb9c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216892.200679:0:8358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88e67a2d3a00/0xf210a9075089eb9c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216892.200686:0:8358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e67a2d3a00/0xf210a9075089eb9c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216892.266232:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216892.266321:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714000128 00000100:00100000:1.0:1782216892.266329:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714000128 00000100:00100000:1.0:1782216892.266375:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 172 00000100:00100000:1.0:1782216892.266384:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+9:5572:x1868789714000128:12345-192.168.203.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782216892.266399:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782216892.266416:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e67fd07c00/0xf210a9075089eba3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6201a9 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216892.266443:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e67fd07c00/0xf210a9075089eba3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6201a9 expref: 10 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216892.266454:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e67fd07c00/0xf210a9075089eba3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6201a9 expref: 10 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216892.266463:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd07c00, rc 0) 00000100:00100000:1.0:1782216892.266525:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:5572:x1868789714000128:12345-192.168.203.19@tcp:101:ll_cfg_requeue.0 Request processed in 141us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216892.266532:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 172 00000100:00100000:3.0:1782216892.271459:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782216892.271603:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714000256 00000100:00100000:0.0:1782216892.271616:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714000256 00000100:00100000:0.0:1782216892.271672:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 173 00000100:00100000:0.0:1782216892.271698:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:5572:x1868789714000256:12345-192.168.203.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782216892.272011:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:5572:x1868789714000256:12345-192.168.203.19@tcp:501:ll_cfg_requeue.0 Request processed in 314us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216892.272019:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 173 00000100:00100000:0.0:1782216892.276228:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216892.276366:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714000384 00000100:00100000:3.0:1782216892.276376:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714000384 00000100:00100000:3.0:1782216892.276426:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 174 00000100:00100000:3.0:1782216892.276435:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:5572:x1868789714000384:12345-192.168.203.19@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782216892.276643:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:5572:x1868789714000384:12345-192.168.203.19@tcp:503:ll_cfg_requeue.0 Request processed in 208us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216892.276651:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 174 00000100:00100000:3.0:1782216892.300150:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216892.300484:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714000512 00000100:00100000:2.0:1782216892.300500:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714000512 00000100:00100000:2.0:1782216892.300571:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 175 00000100:00100000:2.0:1782216892.300581:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:6087:x1868789714000512:12345-192.168.203.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782216892.300830:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:6087:x1868789714000512:12345-192.168.203.19@tcp:502:llog_process_th.0 Request processed in 249us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216892.300844:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 175 00000100:00100000:1.0:1782216892.325685:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216892.325753:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714000640 00000100:00100000:3.0:1782216892.325763:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714000640 00000100:00100000:3.0:1782216892.325816:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 176 00000100:00100000:3.0:1782216892.325825:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:6087:x1868789714000640:12345-192.168.203.19@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782216892.326065:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:6087:x1868789714000640:12345-192.168.203.19@tcp:502:llog_process_th.0 Request processed in 239us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216892.326073:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 176 00000100:00100000:2.0:1782216892.383316:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64846aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789733950464:0@lo:400:kworker.0 00000100:00100000:2.0:1782216892.383381:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216892.383447:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733950464 00000100:00100000:2.0:1782216892.383454:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733950464 00000100:00100000:2.0:1782216892.383497:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782216892.383505:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64846a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789733950464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216892.383556:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64846a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789733950464:12345-0@lo:400:kworker.0 Request processed in 52us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216892.383563:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782216892.383605:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64846aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789733950464:0@lo:400:kworker.0 00000100:00100000:2.0:1782216892.383641:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64846aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733950592:0@lo:400:kworker.0 00000100:00100000:2.0:1782216892.383668:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216892.383703:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733950592 00000100:00100000:2.0:1782216892.383706:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733950592 00000100:00100000:2.0:1782216892.383738:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782216892.383745:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648469180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733950592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216892.383779:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648469180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733950592:12345-0@lo:400:kworker.0 Request processed in 35us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216892.383785:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1782216892.383799:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782216892.383819:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e64846aa00 x1868789733950592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216892.383830:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64846aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733950592:0@lo:400:kworker.0 00000100:00100000:2.0:1782216892.383900:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64846aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1868789733950720:0@lo:400:kworker.0 00000100:00100000:2.0:1782216892.383925:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216892.383970:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64846a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1868789733950848:0@lo:400:kworker.0 00000100:00100000:2.0:1782216892.383992:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216892.384024:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733950720 00000100:00100000:2.0:1782216892.384027:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733950720 00000100:00100000:2.0:1782216892.384048:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733950848 00000100:00100000:2.0:1782216892.384051:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733950848 00000100:00100000:2.0:1782216892.384070:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782216892.384075:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648469500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868789733950720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216892.384107:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648469500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868789733950720:12345-0@lo:400:kworker.0 Request processed in 32us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216892.384113:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782216892.384124:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782216892.384129:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648468e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868789733950848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216892.384244:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648468e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868789733950848:12345-0@lo:400:kworker.0 Request processed in 113us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216892.384251:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1782216892.384265:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782216892.384283:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64846aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1868789733950720:0@lo:400:kworker.0 00000100:00100000:2.0:1782216892.384301:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64846a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1868789733950848:0@lo:400:kworker.0 00000100:00100000:2.0:1782216892.384327:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64846a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733950976:0@lo:400:kworker.0 00000100:00100000:2.0:1782216892.384349:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216892.384380:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733950976 00000100:00100000:2.0:1782216892.384383:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733950976 00000100:00100000:2.0:1782216892.384416:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782216892.384422:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64846aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733950976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216892.384452:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64846aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733950976:12345-0@lo:400:kworker.0 Request processed in 31us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216892.384458:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1782216892.384471:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1782216892.384487:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e64846a300 x1868789733950976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216892.384496:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64846a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733950976:0@lo:400:kworker.0 00000100:00100000:0.0:1782216892.884786:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782216892.884809:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67426c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733951104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782216892.884913:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216892.885038:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733951104 00000100:00100000:1.0:1782216892.885046:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733951104 00000100:00100000:1.0:1782216892.885093:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782216892.885102:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733951104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782216892.885151:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782216892.885222:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733951104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216892.885229:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1782216892.885270:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67426c000 x1868789733951104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216908 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216892.885287:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67426c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733951104:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782216893.013023:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216894.036559:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782216894.167369:0:5780:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782216894.167377:0:5780:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff88e64853e800 from 4 10000000:01000000:2.0:1782216894.167382:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782216894.167428:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2600/0xf210a9075089ebaa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216894.167440:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2600/0xf210a9075089ebaa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216894.167450:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2600/0xf210a9075089ebaa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216894.167475:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64846a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733951232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782216894.167540:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216894.167586:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e65081f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782216894.168978:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733951232 00000100:00100000:3.0:1782216894.169006:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733951232 00000100:00100000:3.0:1782216894.169060:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1782216894.169069:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+16:5780:x1868789733951232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782216894.169085:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782216894.169098:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e653161200/0xf210a9075089ebb1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089ebaa expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216894.169121:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e653161200/0xf210a9075089ebb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089ebaa expref: 17 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216894.169132:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e653161200/0xf210a9075089ebb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089ebaa expref: 17 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216894.169140:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e653161200, rc 0) 00000100:00100000:3.0:1782216894.169205:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+17:5780:x1868789733951232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (1665us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216894.169212:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1782216894.169297:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64846a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733951232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782216894.169314:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2600/0xf210a9075089ebaa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ebb1 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216894.169334:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2600/0xf210a9075089ebaa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089ebb1 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216894.169391:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64846a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733951360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782216894.169419:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216894.169453:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e65081f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782216894.169766:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733951360 00000100:00100000:3.0:1782216894.169771:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733951360 00000100:00100000:3.0:1782216894.169804:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1782216894.169812:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+17:5780:x1868789733951360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782216894.170054:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+17:5780:x1868789733951360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 243us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216894.170061:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1782216894.170138:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64846a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733951360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782216894.170168:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64846a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733951488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782216894.170214:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216894.170242:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e65081f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782216894.176818:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733951488 00000100:00100000:3.0:1782216894.176831:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733951488 00000100:00100000:3.0:1782216894.176892:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1782216894.176902:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+17:5780:x1868789733951488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782216894.177128:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+17:5780:x1868789733951488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 228us (6912us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216894.177135:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1782216894.177207:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64846a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733951488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782216894.177384:0:8445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a801500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:8445:1868789733951616:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782216894.177424:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216894.177450:0:8445:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e642ba3480 going to sleep for 11 seconds 00000100:00100000:2.0:1782216894.181993:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733951616 00000100:00100000:2.0:1782216894.182007:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733951616 00000100:00100000:2.0:1782216894.182062:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1782216894.182071:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+17:8445:x1868789733951616:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782216894.182323:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+17:8445:x1868789733951616:12345-0@lo:502:llog_process_th.0 Request processed in 252us (4897us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216894.182332:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1782216894.183154:0:8445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a801500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:8445:1868789733951616:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782216894.183199:0:8445:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782216894.183209:0:8445:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782216894.183211:0:8445:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1782216894.183219:0:8445:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff88e64853e800 00000020:00000080:0.0:1782216894.183222:0:8445:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1782216894.183317:0:8445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a807480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:8445:1868789733951744:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782216894.183366:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216894.183403:0:8445:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e652456a80 going to sleep for 11 seconds 00000100:00100000:3.0:1782216894.183416:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733951744 00000100:00100000:3.0:1782216894.183422:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733951744 00000100:00100000:3.0:1782216894.183466:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1782216894.183474:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+17:8445:x1868789733951744:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782216894.183635:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+17:8445:x1868789733951744:12345-0@lo:502:llog_process_th.0 Request processed in 161us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216894.183642:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1782216894.183762:0:8445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a807480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:8445:1868789733951744:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782216894.183781:0:8445:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782216894.183785:0:8445:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782216894.183787:0:8445:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1782216894.183791:0:8445:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1782216894.184062:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1782216894.184082:0:5780:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782216894.184092:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2600/0xf210a9075089ebaa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ebb1 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216894.184102:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2600/0xf210a9075089ebaa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ebb1 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782216894.184110:0:5780:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782216894.184112:0:5780:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff88e673f4d000 from 4 10000000:01000000:3.0:1782216894.184115:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782216894.184140:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e653161c00/0xf210a9075089ebb8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216894.184158:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e653161c00/0xf210a9075089ebb8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216894.184167:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e653161c00/0xf210a9075089ebb8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216894.184194:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a803100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733951872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782216894.184225:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216894.184249:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e642ba3480 going to sleep for 11 seconds 00000100:00100000:0.0:1782216894.184732:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733951872 00000100:00100000:0.0:1782216894.184747:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733951872 00000100:00100000:0.0:1782216894.184778:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1782216894.184792:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+17:5780:x1868789733951872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782216894.184802:0:5775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216894.184813:0:5775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e67437ae00/0xf210a9075089ebbf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089ebb8 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216894.184835:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e67437ae00/0xf210a9075089ebbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089ebb8 expref: 18 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216894.184846:0:5775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e67437ae00/0xf210a9075089ebbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089ebb8 expref: 18 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216894.184854:0:5775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437ae00, rc 0) 00000100:00100000:0.0:1782216894.184901:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+18:5780:x1868789733951872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216894.184908:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1782216894.184942:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a803100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733951872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782216894.184956:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e653161c00/0xf210a9075089ebb8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ebbf expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216894.184963:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e653161c00/0xf210a9075089ebb8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089ebbf expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216894.185006:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a803100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733952000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782216894.185032:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216894.185055:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e642ba3480 going to sleep for 11 seconds 00000100:00100000:0.0:1782216894.186991:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733952000 00000100:00100000:0.0:1782216894.187001:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733952000 00000100:00100000:0.0:1782216894.187051:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1782216894.187060:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+18:5780:x1868789733952000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782216894.187334:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+18:5780:x1868789733952000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 275us (2300us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216894.187342:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1782216894.190833:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a803100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733952000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782216894.190907:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a803100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733952128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782216894.190972:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216894.191006:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e642ba3480 going to sleep for 11 seconds 00000100:00100000:3.0:1782216894.191024:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733952128 00000100:00100000:3.0:1782216894.191029:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733952128 00000100:00100000:3.0:1782216894.191077:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1782216894.191084:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+18:5780:x1868789733952128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782216894.191259:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+18:5780:x1868789733952128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216894.191267:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1782216894.191308:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a803100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733952128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782216894.191451:0:8447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a803100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:8447:1868789733952256:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782216894.191480:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216894.191500:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733952256 00000100:00100000:3.0:1782216894.191504:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733952256 00000100:00100000:3.0:1782216894.191523:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1782216894.191529:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e65774ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+18:8447:x1868789733952256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782216894.191632:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e65774ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+18:8447:x1868789733952256:12345-0@lo:502:llog_process_th.0 Request processed in 103us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216894.191639:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1782216894.191667:0:8447:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e642ba3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782216894.191677:0:8447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a803100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:8447:1868789733952256:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782216894.192803:0:8447:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782216894.192816:0:8447:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782216894.192818:0:8447:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1782216894.192826:0:8447:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff88e673f4d000 00000020:00000080:3.0:1782216894.192828:0:8447:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1782216894.192911:0:8447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a803100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:8447:1868789733952384:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782216894.192963:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216894.192996:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733952384 00000100:00100000:3.0:1782216894.193005:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733952384 00000100:00100000:3.0:1782216894.193037:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1782216894.193044:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e65774d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+18:8447:x1868789733952384:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782216894.193195:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e65774d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+18:8447:x1868789733952384:12345-0@lo:502:llog_process_th.0 Request processed in 140us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216894.193202:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1782216894.193236:0:8447:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e642ba3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782216894.193251:0:8447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a803100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:8447:1868789733952384:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782216894.193267:0:8447:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782216894.193271:0:8447:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782216894.193273:0:8447:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1782216894.193276:0:8447:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1782216894.193328:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1782216894.193342:0:5780:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782216894.193352:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e653161c00/0xf210a9075089ebb8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ebbf expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216894.193362:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e653161c00/0xf210a9075089ebb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ebbf expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782216894.193372:0:5780:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782216894.193375:0:5780:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff88e650a2a800 from 4 10000000:01000000:3.0:1782216894.193377:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782216894.193399:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e653161600/0xf210a9075089ebc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216894.193406:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e653161600/0xf210a9075089ebc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216894.193415:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e653161600/0xf210a9075089ebc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216894.193432:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a803100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733952512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782216894.193455:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216894.193468:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e642ba3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782216894.193481:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733952512 00000100:00100000:3.0:1782216894.193484:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733952512 00000100:00100000:3.0:1782216894.193503:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1782216894.193508:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e65774f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+18:5780:x1868789733952512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782216894.193516:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782216894.193527:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e653160400/0xf210a9075089ebcd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089ebc6 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216894.193547:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e653160400/0xf210a9075089ebcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089ebc6 expref: 19 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216894.193556:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e653160400/0xf210a9075089ebcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089ebc6 expref: 19 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216894.193563:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e653160400, rc 0) 00000100:00100000:3.0:1782216894.193589:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e65774f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+19:5780:x1868789733952512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216894.193595:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1782216894.193622:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a803100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733952512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782216894.193634:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e653161600/0xf210a9075089ebc6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ebcd expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216894.193641:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e653161600/0xf210a9075089ebc6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089ebcd expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216894.193696:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a803100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733952640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782216894.193719:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216894.193732:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e642ba3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782216894.193742:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733952640 00000100:00100000:3.0:1782216894.193745:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733952640 00000100:00100000:3.0:1782216894.193765:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1782216894.193770:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e65774d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+19:5780:x1868789733952640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782216894.193979:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e65774d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+19:5780:x1868789733952640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 208us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216894.193986:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1782216894.194024:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a803100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733952640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782216894.194049:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a803100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733952768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782216894.194080:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216894.194092:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e67abf9180 going to sleep for 11 seconds 00000100:00100000:3.0:1782216894.194103:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733952768 00000100:00100000:3.0:1782216894.194106:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733952768 00000100:00100000:3.0:1782216894.194124:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1782216894.194129:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e65774c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+19:5780:x1868789733952768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782216894.194238:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e65774c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+19:5780:x1868789733952768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216894.194244:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1782216894.194278:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a803100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733952768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782216894.197909:0:8449:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a803100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:8449:1868789733952896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782216894.197992:0:8449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216894.198027:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733952896 00000100:00100000:3.0:1782216894.198032:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733952896 00000100:00100000:3.0:1782216894.198071:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1782216894.198079:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e65774e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+19:8449:x1868789733952896:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782216894.198834:0:8449:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e67abf9180 going to sleep for 11 seconds 00000100:00100000:3.0:1782216894.199613:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e65774e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+19:8449:x1868789733952896:12345-0@lo:502:llog_process_th.0 Request processed in 1531us (1618us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216894.199625:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1782216894.201966:0:8449:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a803100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:8449:1868789733952896:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782216894.211120:0:8449:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782216894.211133:0:8449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216894.211135:0:8449:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1782216894.211143:0:8449:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff88e650a2a800 00000020:00000080:1.0:1782216894.211145:0:8449:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1782216894.212561:0:8449:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67426c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:8449:1868789733953024:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782216894.212638:0:8449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216894.215271:0:8449:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e67f6dec00 going to sleep for 11 seconds 00000100:00100000:3.0:1782216894.218620:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733953024 00000100:00100000:3.0:1782216894.218635:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733953024 00000100:00100000:3.0:1782216894.218700:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1782216894.218709:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e65774f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+19:8449:x1868789733953024:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782216894.218956:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e65774f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+19:8449:x1868789733953024:12345-0@lo:502:llog_process_th.0 Request processed in 247us (6317us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216894.218964:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1782216894.219087:0:8449:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67426c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:8449:1868789733953024:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782216894.219120:0:8449:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782216894.219128:0:8449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216894.219130:0:8449:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1782216894.219134:0:8449:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1782216894.219280:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1782216894.219297:0:5780:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782216894.219306:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e653161600/0xf210a9075089ebc6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ebcd expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216894.219317:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e653161600/0xf210a9075089ebc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ebcd expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216895.060790:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216895.446048:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733953152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782216895.446125:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216895.446208:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733953152 00000100:00100000:0.0:1782216895.446215:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733953152 00000100:00100000:0.0:1782216895.446264:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782216895.446284:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733953152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782216895.446315:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782216895.446356:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733953152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216895.446363:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1782216895.446382:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782216895.446410:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67a807480 x1868789733953152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216911 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216895.446428:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733953152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782216895.493310:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216895.493355:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216895.493388:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216895.493423:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216895.493473:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714001024 00000100:00100000:3.0:1782216895.493482:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714001024 00000100:00100000:3.0:1782216895.493537:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714001152 00000100:00100000:3.0:1782216895.493541:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714001152 00000100:00100000:3.0:1782216895.493565:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 19 00000100:00100000:3.0:1782216895.493575:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2356:x1868789714001024:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:3.0:1782216895.493646:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2356:x1868789714001024:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 73us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216895.493653:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 19 00000100:00100000:3.0:1782216895.493669:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 20 00000100:00100000:3.0:1782216895.493674:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2356:x1868789714001152:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:3.0:1782216895.493706:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2356:x1868789714001152:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 31us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216895.493712:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 20 00000100:00080000:3.0:1782216895.493796:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782216895.493800:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782216895.494092:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714000768 00000100:00100000:0.0:1782216895.494098:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714000768 00000100:00100000:0.0:1782216895.494139:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 192 00000100:00100000:0.0:1782216895.494147:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e68044f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:2356:x1868789714000768:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:0.0:1782216895.494191:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e68044f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:2356:x1868789714000768:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 46us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216895.494199:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 192 00000100:00100000:1.0:1782216895.494322:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714000896 00000100:00100000:1.0:1782216895.494327:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714000896 00000100:00100000:1.0:1782216895.494376:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 31 00000100:00100000:1.0:1782216895.494383:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a800a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2356:x1868789714000896:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:1.0:1782216895.494414:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a800a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2356:x1868789714000896:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 32us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216895.494428:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 31 00000100:00080000:0.0:1782216895.496494:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782216896.093843:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216897.108316:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216897.494366:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733953280:0@lo:400:kworker.0 00000100:00100000:0.0:1782216897.494460:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216897.494519:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1868789733953792:0@lo:400:kworker.0 00000100:00100000:0.0:1782216897.494546:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216897.494573:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782216897.494579:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1868789733953664:0@lo:400:kworker.0 00000100:00100000:0.0:1782216897.494616:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216897.494649:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789733953408:0@lo:400:kworker.0 00000100:00100000:0.0:1782216897.494680:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216897.494699:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733953920:0@lo:400:kworker.0 00000100:00100000:0.0:1782216897.494723:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216897.494741:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782216897.494746:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733953536:0@lo:400:kworker.0 00000100:00100000:0.0:1782216897.494766:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216897.494799:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733953280 00000100:00100000:0.0:1782216897.494808:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733953280 00000100:00100000:0.0:1782216897.494861:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1782216897.494870:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e68044d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+19:3304:x1868789733953280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216897.494951:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e68044d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+19:3304:x1868789733953280:12345-0@lo:400:kworker.0 Request processed in 81us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216897.495576:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1782216897.495633:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733953792 00000100:00100000:0.0:1782216897.495638:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733953792 00000100:00100000:0.0:1782216897.495683:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733953664 00000100:00100000:0.0:1782216897.495686:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733953664 00000100:00100000:0.0:1782216897.495699:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733953408 00000100:00100000:0.0:1782216897.495702:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733953408 00000100:00100000:0.0:1782216897.495714:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782216897.495720:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868789733953792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216897.495767:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868789733953792:12345-0@lo:400:kworker.0 Request processed in 47us (1219us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216897.495773:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782216897.495784:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782216897.495790:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648544380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868789733953664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216897.495815:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648544380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868789733953664:12345-0@lo:400:kworker.0 Request processed in 25us (1197us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216897.495846:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782216897.496114:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782216897.496123:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789733953408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216897.496172:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789733953408:12345-0@lo:400:kworker.0 Request processed in 51us (1490us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216897.496179:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782216897.496212:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733953920 00000100:00100000:0.0:1782216897.496217:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733953920 00000100:00100000:0.0:1782216897.496249:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733953536 00000100:00100000:0.0:1782216897.496253:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733953536 00000100:00100000:0.0:1782216897.496273:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782216897.496279:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733953920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216897.496310:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733953920:12345-0@lo:400:kworker.0 Request processed in 31us (1586us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216897.496315:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782216897.496326:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782216897.496331:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733953536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216897.496358:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733953536:12345-0@lo:400:kworker.0 Request processed in 27us (1592us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216897.496364:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1782216897.496389:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782216897.496394:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782216897.496397:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1782216897.496446:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67a1f2680 x1868789733953536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216897.496462:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733953536:0@lo:400:kworker.0 00000100:00100000:0.0:1782216897.496487:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789733953408:0@lo:400:kworker.0 00010000:00080000:0.0:1782216897.496498:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67a1f0380 x1868789733953920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216897.496508:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733953920:0@lo:400:kworker.0 00000100:00100000:0.0:1782216897.496553:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1868789733953664:0@lo:400:kworker.0 00000100:00100000:0.0:1782216897.496563:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733953280:0@lo:400:kworker.0 00000100:00100000:0.0:1782216897.496574:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1868789733953792:0@lo:400:kworker.0 00000100:00100000:1.0:1782216898.004013:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782216898.004046:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67426c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733954048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782216898.004377:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216898.004440:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733954048 00000100:00100000:1.0:1782216898.004447:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733954048 00000100:00100000:1.0:1782216898.004488:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782216898.004497:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67426f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733954048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782216898.004530:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782216898.004572:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67426f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733954048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216898.004579:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1782216898.004618:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67426c000 x1868789733954048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216914 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216898.004648:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67426c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733954048:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782216898.133124:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782216899.119642:0:8656:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg319-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1782216899.157447:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216900.185770:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216900.568059:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782216900.568080:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733954176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782216900.568159:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216900.568397:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733954176 00000100:00100000:0.0:1782216900.568405:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733954176 00000100:00100000:0.0:1782216900.568476:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782216900.568486:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64846bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733954176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782216900.568518:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782216900.568563:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64846bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733954176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216900.568570:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1782216900.568607:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e648546680 x1868789733954176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216916 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216900.568625:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733954176:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782216900.569416:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782216900.637176:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216900.637224:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216900.637259:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216900.637295:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216900.637329:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714001536 00000100:00100000:3.0:1782216900.637359:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714001536 00000100:00100000:3.0:1782216900.637415:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714001664 00000100:00100000:3.0:1782216900.637419:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714001664 00000100:00100000:3.0:1782216900.637442:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 11 00000100:00100000:3.0:1782216900.637451:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a801500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2355:x1868789714001536:12345-192.168.203.19@tcp:9:kworker.0 00000020:00000080:3.0:1782216900.637489:0:7991:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf210a9075089eb09 00000100:00080000:3.0:1782216900.637498:0:7991:0:(import.c:65:import_set_state_nolock()) ffff88e67a472000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782216900.637530:0:7991:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1782216900.637904:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a801500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+2:2355:x1868789714001536:12345-192.168.203.19@tcp:9:kworker.0 Request processed in 422us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216900.637915:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 11 00000100:00100000:3.0:1782216900.637932:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 12 00000100:00100000:3.0:1782216900.637939:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2355:x1868789714001664:12345-192.168.203.19@tcp:9:kworker.0 00000020:00000080:3.0:1782216900.637953:0:7991:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf210a9075089eb10 00000100:00080000:3.0:1782216900.637960:0:7991:0:(import.c:65:import_set_state_nolock()) ffff88e67a471000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782216900.637981:0:7991:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1782216900.638184:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+2:2355:x1868789714001664:12345-192.168.203.19@tcp:9:kworker.0 Request processed in 244us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216900.638191:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 12 00010000:00010000:3.0:1782216900.638220:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216900.638322:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782216900.638330:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782216900.638334:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782216900.638451:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714001280 00000100:00100000:1.0:1782216900.638457:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714001280 00000100:00100000:1.0:1782216900.638496:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 194 00000100:00100000:1.0:1782216900.638503:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e68044c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:2359:x1868789714001280:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:1.0:1782216900.638537:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e68044c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:2359:x1868789714001280:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 35us (1313us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216900.638544:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 194 00000100:00100000:2.0:1782216900.639041:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714001408 00000100:00100000:2.0:1782216900.639046:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714001408 00000100:00100000:2.0:1782216900.639094:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 35 00000100:00100000:2.0:1782216900.639111:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a802a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2359:x1868789714001408:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:2.0:1782216900.639158:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a802a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2359:x1868789714001408:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 47us (1897us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216900.639164:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 35 00000100:00080000:1.0:1782216900.639231:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782216901.204532:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216902.229218:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216902.613434:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648468000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1868789733954688:0@lo:400:kworker.0 00000100:00100000:2.0:1782216902.613527:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216902.613600:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782216902.613606:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648468700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789733954304:0@lo:400:kworker.0 00000100:00100000:2.0:1782216902.613636:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216902.613656:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64846b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1868789733954816:0@lo:400:kworker.0 00000100:00100000:2.0:1782216902.613673:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216902.613696:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648469880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789733954432:0@lo:400:kworker.0 00000100:00100000:2.0:1782216902.613715:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216902.613729:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64846b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733954944:0@lo:400:kworker.0 00000100:00100000:2.0:1782216902.613749:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216902.613765:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782216902.613771:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648469c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733954560:0@lo:400:kworker.0 00000100:00100000:2.0:1782216902.613791:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216902.613825:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733954688 00000100:00100000:2.0:1782216902.613834:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733954688 00000100:00100000:2.0:1782216902.613922:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733954816 00000100:00100000:2.0:1782216902.613926:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733954816 00000100:00100000:2.0:1782216902.614390:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733954432 00000100:00100000:2.0:1782216902.614396:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733954432 00000100:00100000:2.0:1782216902.614414:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1782216902.614424:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64846a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868789733954688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216902.616069:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64846a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868789733954688:12345-0@lo:400:kworker.0 Request processed in 1635us (2531us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216902.616083:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1782216902.616151:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782216902.616167:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64846b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1868789733954816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216902.616230:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64846b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1868789733954816:12345-0@lo:400:kworker.0 Request processed in 71us (2555us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216902.616236:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782216902.616247:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782216902.616254:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789733954432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216902.616293:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789733954432:12345-0@lo:400:kworker.0 Request processed in 40us (2576us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216902.616299:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782216902.616389:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733954304 00000100:00100000:2.0:1782216902.616396:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733954304 00000100:00100000:2.0:1782216902.616436:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1782216902.616443:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e68044e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+19:3303:x1868789733954304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216902.616475:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e68044e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+19:3303:x1868789733954304:12345-0@lo:400:kworker.0 Request processed in 33us (2838us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216902.616481:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:2.0:1782216902.616522:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782216902.616569:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648469880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789733954432:0@lo:400:kworker.0 00000100:00100000:3.0:1782216902.617454:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733954944 00000100:00100000:3.0:1782216902.617463:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733954944 00000100:00100000:3.0:1782216902.617507:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733954560 00000100:00100000:3.0:1782216902.617510:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733954560 00000100:00100000:3.0:1782216902.617551:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782216902.617559:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733954944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216902.617618:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733954944:12345-0@lo:400:kworker.0 Request processed in 60us (3867us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216902.617625:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782216902.617638:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782216902.617644:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64846ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733954560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216902.617669:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64846ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733954560:12345-0@lo:400:kworker.0 Request processed in 26us (3877us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216902.617675:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1782216902.618623:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782216902.618630:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1782216902.618678:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e648469c00 x1868789733954560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216902.618695:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648469c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733954560:0@lo:400:kworker.0 00010000:00080000:3.0:1782216902.618709:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e64846b800 x1868789733954944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216902.618718:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64846b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733954944:0@lo:400:kworker.0 00000100:00100000:0.0:1782216902.626842:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648468000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1868789733954688:0@lo:400:kworker.0 00000100:00100000:0.0:1782216902.626902:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648468700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789733954304:0@lo:400:kworker.0 00000100:00100000:0.0:1782216902.626918:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64846b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1868789733954816:0@lo:400:kworker.0 00000001:00100000:1.0:1782216902.712459:0:6609:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 10ba4d21-74e8-42e8-8e52-48a327751cbd 00000020:00000080:1.0:1782216902.712475:0:6609:0:(genops.c:906:class_export_put()) final put ffff88e67a470800/10ba4d21-74e8-42e8-8e52-48a327751cbd 00000020:00000080:1.0:1782216902.712531:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff88e67a470800/10ba4d21-74e8-42e8-8e52-48a327751cbd for lustre-OST0000 00000020:00000080:1.0:1782216902.726070:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff88e67a472000 for lustre-OST0000 00000100:00100000:3.0:1782216903.127046:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782216903.127067:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733955072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782216903.127156:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216903.127659:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733955072 00000100:00100000:0.0:1782216903.127666:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733955072 00000100:00100000:0.0:1782216903.127718:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782216903.127726:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f62d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733955072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782216903.127760:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782216903.127816:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f62d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733955072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216903.127823:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1782216903.128000:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67a1e7800 x1868789733955072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216919 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216903.128020:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733955072:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782216903.262461:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782216904.208424:0:8901:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg319-server.virtnet: executing yml_node 00010000:00010000:0.0:1782216904.277193:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216905.300387:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216905.691420:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648469880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733955200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782216905.691497:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216905.691565:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733955200 00000100:00100000:2.0:1782216905.691572:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733955200 00000100:00100000:2.0:1782216905.691624:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782216905.691632:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64846b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733955200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782216905.691667:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782216905.691709:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64846b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733955200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216905.691982:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1782216905.692302:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e648469880 x1868789733955200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216921 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216905.692323:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648469880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733955200:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782216905.692358:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782216905.726961:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782216905.727000:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782216905.727037:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714001920 00000100:00100000:0.0:1782216905.727045:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714001920 00000100:00100000:0.0:1782216905.727123:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 39 00000100:00100000:0.0:1782216905.727134:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2356:x1868789714001920:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:0.0:1782216905.727205:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2356:x1868789714001920:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 73us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216905.727212:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 39 00000100:00080000:0.0:1782216905.727321:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782216905.727494:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714001792 00000100:00100000:3.0:1782216905.727511:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714001792 00000100:00100000:3.0:1782216905.727597:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 196 00000100:00100000:3.0:1782216905.727607:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e68044f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:2356:x1868789714001792:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:3.0:1782216905.727644:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e68044f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:2356:x1868789714001792:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 39us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216905.727650:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 196 00000001:00100000:0.0:1782216905.755890:0:7488:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 10ba4d21-74e8-42e8-8e52-48a327751cbd 00000020:00000080:0.0:1782216905.755900:0:7488:0:(genops.c:906:class_export_put()) final put ffff88e67a476000/10ba4d21-74e8-42e8-8e52-48a327751cbd 00000020:00000080:3.0:1782216905.755976:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff88e67a476000/10ba4d21-74e8-42e8-8e52-48a327751cbd for lustre-OST0001 00000020:00000080:3.0:1782216905.756024:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff88e67a471000 for lustre-OST0001 00010000:00010000:0.0:1782216906.324226:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216907.349166:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216907.733681:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648544e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789733955456:0@lo:400:kworker.0 00000100:00100000:0.0:1782216907.733681:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648547b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733955584:0@lo:400:kworker.0 00000100:00100000:1.0:1782216907.733901:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648544700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1868789733955712:0@lo:400:kworker.0 00000100:00100000:2.0:1782216907.734242:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648546300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733955328:0@lo:400:kworker.0 00000100:00100000:3.0:1782216907.741618:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216907.741701:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648545c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733955968:0@lo:400:kworker.0 00000100:00100000:3.0:1782216907.741757:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216907.741948:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733955968 00000100:00100000:3.0:1782216907.741956:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733955968 00000100:00100000:3.0:1782216907.742008:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782216907.742016:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f62e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733955968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216907.742068:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f62e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733955968:12345-0@lo:400:kworker.0 Request processed in 53us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216907.742074:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782216907.742940:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782216907.743006:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782216907.743719:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216907.743750:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648545880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1868789733955840:0@lo:400:kworker.0 00000100:00100000:2.0:1782216907.743781:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216907.743937:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733955456 00000100:00100000:2.0:1782216907.743943:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733955456 00000100:00100000:2.0:1782216907.743977:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733955840 00000100:00100000:2.0:1782216907.743979:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733955840 00000100:00100000:2.0:1782216907.744001:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782216907.744009:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f62d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789733955456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216907.744048:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f62d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789733955456:12345-0@lo:400:kworker.0 Request processed in 41us (2437us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216907.744065:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782216907.744078:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1782216907.744095:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868789733955840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216907.744130:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868789733955840:12345-0@lo:400:kworker.0 Request processed in 46us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216907.744136:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1782216907.744575:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733955328 00000100:00100000:2.0:1782216907.744579:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733955328 00000100:00100000:3.0:1782216907.744701:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733955584 00000100:00100000:3.0:1782216907.744706:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733955584 00000100:00100000:3.0:1782216907.744750:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782216907.744758:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733955584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216907.744982:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733955584:12345-0@lo:400:kworker.0 Request processed in 225us (2043us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216907.744989:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1782216907.745049:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e648545c00 x1868789733955968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216907.745062:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648545c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733955968:0@lo:400:kworker.0 00000100:00100000:3.0:1782216907.745074:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648544e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789733955456:0@lo:400:kworker.0 00010000:00080000:3.0:1782216907.745291:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e648547b80 x1868789733955584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216907.745301:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648547b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733955584:0@lo:400:kworker.0 00000100:00080000:0.0:1782216907.748381:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782216907.748391:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782216907.748531:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1782216907.748548:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e68044f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+19:3304:x1868789733955328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216907.748918:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648545880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1868789733955840:0@lo:400:kworker.0 00000100:00100000:2.0:1782216907.749022:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e68044f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+19:3304:x1868789733955328:12345-0@lo:400:kworker.0 Request processed in 481us (5303us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216907.749030:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1782216907.749122:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648546300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733955328:0@lo:400:kworker.0 00000100:00100000:1.0:1782216907.753130:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216907.753352:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733955712 00000100:00100000:0.0:1782216907.753364:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733955712 00000100:00100000:0.0:1782216907.753473:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1782216907.753490:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67426c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868789733955712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216907.753593:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67426c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868789733955712:12345-0@lo:400:kworker.0 Request processed in 110us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216907.753603:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1782216907.754123:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782216907.754165:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648544700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1868789733955712:0@lo:400:kworker.0 00000100:00100000:1.0:1782216908.244124:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f62e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733956096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782216908.244187:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216908.244275:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733956096 00000100:00100000:3.0:1782216908.244282:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733956096 00000100:00100000:3.0:1782216908.244336:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782216908.244345:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67426f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733956096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782216908.244390:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782216908.244432:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67426f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733956096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216908.244439:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1782216908.244482:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67f62e300 x1868789733956096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216924 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216908.244497:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f62e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733956096:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782216908.372030:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782216908.688404:0:9093:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.83 00010000:00010000:3.0:1782216909.398064:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216910.420113:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216910.804943:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782216910.804966:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648468700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733956224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782216910.805034:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216910.805207:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733956224 00000100:00100000:2.0:1782216910.805215:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733956224 00000100:00080000:1.0:1782216910.805243:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782216910.805269:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782216910.805282:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648546300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733956224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782216910.805314:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782216910.805365:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648546300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733956224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216910.805372:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1782216910.805465:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e648468700 x1868789733956224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216926 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216910.805482:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648468700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733956224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782216910.860178:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782216910.860230:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216910.860440:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714002048 00000100:00100000:1.0:1782216910.860452:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714002048 00000100:00100000:1.0:1782216910.860510:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 198 00000100:00100000:1.0:1782216910.860520:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e68044d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:2358:x1868789714002048:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:1.0:1782216910.860601:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e68044d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:2358:x1868789714002048:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 83us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216910.860609:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 198 00000100:00100000:2.0:1782216910.861369:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714002176 00000100:00100000:2.0:1782216910.861377:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714002176 00000100:00100000:2.0:1782216910.861435:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 43 00000100:00100000:2.0:1782216910.861455:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2358:x1868789714002176:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:2.0:1782216910.861492:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2358:x1868789714002176:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 39us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216910.861499:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 43 00000100:00080000:1.0:1782216910.862761:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782216911.446250:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782216911.834999:0:9192:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.83 00010000:00010000:2.0:1782216912.470189:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216912.856436:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782216912.856465:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648468000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789733956352:0@lo:400:kworker.0 00000100:00100000:2.0:1782216912.856557:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216912.856628:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733956352 00000100:00100000:2.0:1782216912.856637:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733956352 00000100:00100000:2.0:1782216912.856693:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1782216912.856703:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e68044cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+19:3303:x1868789733956352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216912.856764:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e68044cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+19:3303:x1868789733956352:12345-0@lo:400:kworker.0 Request processed in 62us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216912.856772:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1782216912.856831:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648468000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789733956352:0@lo:400:kworker.0 00000100:00100000:2.0:1782216912.856930:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648468000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789733956480:0@lo:400:kworker.0 00000100:00100000:2.0:1782216912.856962:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216912.856997:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733956480 00000100:00100000:2.0:1782216912.857000:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733956480 00000100:00100000:2.0:1782216912.862160:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782216912.862184:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64846b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789733956480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216912.862494:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64846b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789733956480:12345-0@lo:400:kworker.0 Request processed in 320us (5529us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216912.862523:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782216912.862598:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648468000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789733956480:0@lo:400:kworker.0 00000100:00100000:0.0:1782216912.862726:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648468000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733956608:0@lo:400:kworker.0 00000100:00100000:0.0:1782216912.862769:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216912.863491:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648469c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1868789733956736:0@lo:400:kworker.0 00000100:00100000:2.0:1782216912.863527:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216912.863577:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733956736 00000100:00100000:2.0:1782216912.863585:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733956736 00000100:00100000:2.0:1782216912.863808:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782216912.863820:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868789733956736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216912.863872:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868789733956736:12345-0@lo:400:kworker.0 Request processed in 56us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216912.863899:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1782216912.863925:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782216912.867097:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648469c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1868789733956736:0@lo:400:kworker.0 00000100:00100000:2.0:1782216912.867207:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648469c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1868789733956864:0@lo:400:kworker.0 00000100:00100000:2.0:1782216912.867269:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216912.867316:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733956864 00000100:00100000:2.0:1782216912.867324:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733956864 00000100:00100000:2.0:1782216912.868027:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1782216912.868045:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868789733956864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216912.868113:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868789733956864:12345-0@lo:400:kworker.0 Request processed in 77us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216912.868120:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1782216912.868147:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782216912.868174:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648469c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1868789733956864:0@lo:400:kworker.0 00000100:00100000:0.0:1782216912.869342:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733956608 00000100:00100000:0.0:1782216912.869354:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733956608 00000100:00100000:0.0:1782216912.869853:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782216912.869865:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733956608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216912.869963:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733956608:12345-0@lo:400:kworker.0 Request processed in 101us (7193us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216912.869971:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1782216912.870079:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782216912.870115:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e648468000 x1868789733956608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216912.870129:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648468000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733956608:0@lo:400:kworker.0 00000100:00100000:2.0:1782216912.870769:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67fff7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733956992:0@lo:400:kworker.0 00000100:00100000:2.0:1782216912.870815:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216912.870852:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733956992 00000100:00100000:2.0:1782216912.870857:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733956992 00000100:00100000:2.0:1782216912.870915:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782216912.870923:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733956992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216912.870980:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733956992:12345-0@lo:400:kworker.0 Request processed in 57us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216912.870986:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1782216912.871003:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1782216912.871021:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67fff7100 x1868789733956992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216912.871040:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67fff7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733956992:0@lo:400:kworker.0 00000100:00100000:2.0:1782216913.364144:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782216913.370621:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f62e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733957120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782216913.370761:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216913.381753:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733957120 00000100:00100000:3.0:1782216913.381766:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733957120 00000100:00100000:3.0:1782216913.381836:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782216913.381845:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fff7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733957120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782216913.381894:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782216913.381994:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fff7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733957120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 149us (11233us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216913.382001:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1782216913.382754:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67f62e300 x1868789733957120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216929 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216913.382779:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f62e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733957120:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782216913.492551:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216914.516444:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782216914.806928:0:9289:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.83 00010000:00010000:2.0:1782216915.541430:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216915.924302:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782216915.924336:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67fff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733957248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782216915.924430:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216915.924548:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733957248 00000100:00100000:2.0:1782216915.924558:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733957248 00000100:00100000:2.0:1782216915.924627:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782216915.924637:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fff5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733957248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782216915.924685:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782216915.924745:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fff5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733957248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216915.924753:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1782216915.924779:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782216915.924816:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67fff6a00 x1868789733957248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216931 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216915.924838:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67fff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733957248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782216915.993084:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216915.993134:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216915.993263:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714002432 00000100:00100000:1.0:1782216915.993273:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714002432 00000100:00100000:1.0:1782216915.993359:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 47 00000100:00100000:1.0:1782216915.993371:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f62ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2356:x1868789714002432:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:1.0:1782216915.993447:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f62ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2356:x1868789714002432:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 79us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216915.993469:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 47 00000100:00080000:3.0:1782216915.994078:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782216915.995237:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714002304 00000100:00100000:2.0:1782216915.995258:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714002304 00000100:00100000:2.0:1782216915.995357:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 200 00000100:00100000:2.0:1782216915.995371:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e68044c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:2356:x1868789714002304:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:2.0:1782216915.995489:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e68044c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:2356:x1868789714002304:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 121us (2416us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216915.995505:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 200 00010000:00010000:0.0:1782216916.572822:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782216916.584971:0:9338:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Jun 23 08:15:14 EDT 2026 00010000:00010000:2.0:1782216917.588123:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216917.976083:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f62fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733957376:0@lo:400:kworker.0 00000100:00100000:3.0:1782216917.976148:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216917.976189:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f62c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1868789733957888:0@lo:400:kworker.0 00000100:00100000:3.0:1782216917.976213:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216917.976237:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782216917.976243:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f62dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1868789733957760:0@lo:400:kworker.0 00000100:00100000:3.0:1782216917.976263:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216917.976299:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f62c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789733957504:0@lo:400:kworker.0 00000100:00100000:3.0:1782216917.976319:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216917.976333:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f62f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733958016:0@lo:400:kworker.0 00000100:00100000:3.0:1782216917.976354:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216917.976369:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782216917.976374:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f62d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733957632:0@lo:400:kworker.0 00000100:00100000:3.0:1782216917.976393:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216917.976473:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733957376 00000100:00100000:1.0:1782216917.976474:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733957888 00000100:00100000:3.0:1782216917.976480:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733957376 00000100:00100000:1.0:1782216917.976480:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733957888 00000100:00100000:3.0:1782216917.976519:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1782216917.976523:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733957760 00000100:00100000:1.0:1782216917.976526:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733957760 00000100:00100000:3.0:1782216917.976527:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+19:3304:x1868789733957376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216917.976537:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733957504 00000100:00100000:1.0:1782216917.976539:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733957504 00000100:00100000:1.0:1782216917.976549:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1782216917.976555:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f62f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868789733957888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216917.976572:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+19:3304:x1868789733957376:12345-0@lo:400:kworker.0 Request processed in 46us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216917.976584:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f62f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868789733957888:12345-0@lo:400:kworker.0 Request processed in 30us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216917.976590:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782216917.976591:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1782216917.976604:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1782216917.976609:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f62ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868789733957760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216917.976618:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1782216917.976624:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f62f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789733957504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216917.976632:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f62ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868789733957760:12345-0@lo:400:kworker.0 Request processed in 24us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216917.976638:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782216917.976650:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f62f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789733957504:12345-0@lo:400:kworker.0 Request processed in 26us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216917.976671:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1782216917.976689:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733958016 00000100:00100000:3.0:1782216917.976693:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733958016 00000100:00100000:3.0:1782216917.976725:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733957632 00000100:00100000:3.0:1782216917.976727:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733957632 00000100:00100000:3.0:1782216917.976750:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782216917.976756:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f62df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733958016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216917.976784:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f62df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733958016:12345-0@lo:400:kworker.0 Request processed in 29us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216917.976790:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782216917.976800:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782216917.976805:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f62ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733957632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216917.976830:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f62ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733957632:12345-0@lo:400:kworker.0 Request processed in 24us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216917.976835:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1782216917.976866:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782216917.976870:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782216917.976873:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782216917.976933:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f62dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1868789733957760:0@lo:400:kworker.0 00000100:00100000:3.0:1782216917.976943:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f62fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733957376:0@lo:400:kworker.0 00000100:00100000:3.0:1782216917.976963:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f62c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1868789733957888:0@lo:400:kworker.0 00010000:00080000:3.0:1782216917.977004:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67f62d880 x1868789733957632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216917.977023:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f62d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733957632:0@lo:400:kworker.0 00000100:00100000:3.0:1782216917.977033:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f62c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789733957504:0@lo:400:kworker.0 00010000:00080000:3.0:1782216917.977042:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67f62f480 x1868789733958016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216917.977051:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f62f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733958016:0@lo:400:kworker.0 00000100:00100000:0.0:1782216918.484658:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f62f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733958144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782216918.484731:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216918.484966:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733958144 00000100:00100000:2.0:1782216918.484974:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733958144 00000100:00100000:2.0:1782216918.485033:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782216918.485042:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648547800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733958144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782216918.485075:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782216918.485160:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648547800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733958144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216918.485180:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1782216918.485299:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67f62f480 x1868789733958144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216934 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216918.485316:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f62f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733958144:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782216918.612147:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216919.640437:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216920.660468:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216921.053455:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f62f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733958272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782216921.053562:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216921.058854:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733958272 00000100:00100000:3.0:1782216921.058893:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733958272 00000100:00100000:3.0:1782216921.059003:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782216921.059017:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f62c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733958272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782216921.059081:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782216921.059195:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f62c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733958272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 182us (5632us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216921.059204:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1782216921.059239:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782216921.059298:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67f62f480 x1868789733958272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216937 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216921.059345:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f62f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733958272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782216921.085216:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216921.085289:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216921.085437:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714002560 00000100:00100000:2.0:1782216921.085451:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714002560 00000100:00100000:2.0:1782216921.085504:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 202 00000100:00100000:2.0:1782216921.085513:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:2359:x1868789714002560:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:2.0:1782216921.085605:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:2359:x1868789714002560:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 92us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216921.085613:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 202 00000100:00100000:0.0:1782216921.087226:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714002688 00000100:00100000:0.0:1782216921.087240:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714002688 00000100:00100000:0.0:1782216921.087563:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 51 00000100:00100000:0.0:1782216921.087576:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f62f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2359:x1868789714002688:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:0.0:1782216921.087661:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f62f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2359:x1868789714002688:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 89us (2380us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216921.087669:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 51 00000100:00080000:2.0:1782216921.097413:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782216921.685608:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216922.710479:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216923.092900:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67fff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733958400:0@lo:400:kworker.0 00000100:00100000:2.0:1782216923.092968:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216923.093019:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67fff6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1868789733958912:0@lo:400:kworker.0 00000100:00100000:2.0:1782216923.093040:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216923.093061:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782216923.093066:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67fff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1868789733958784:0@lo:400:kworker.0 00000100:00100000:2.0:1782216923.093098:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216923.093127:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67fff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789733958528:0@lo:400:kworker.0 00000100:00100000:2.0:1782216923.093148:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216923.093165:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67fff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733959040:0@lo:400:kworker.0 00000100:00100000:2.0:1782216923.093187:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216923.093204:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782216923.093209:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67fff4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733958656:0@lo:400:kworker.0 00000100:00100000:2.0:1782216923.093228:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216923.093257:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733958400 00000100:00100000:2.0:1782216923.093269:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733958400 00000100:00100000:2.0:1782216923.093307:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1782216923.093314:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+19:3304:x1868789733958400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216923.093355:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+19:3304:x1868789733958400:12345-0@lo:400:kworker.0 Request processed in 41us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216923.093362:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1782216923.093385:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733958912 00000100:00100000:2.0:1782216923.093388:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733958912 00000100:00100000:2.0:1782216923.093427:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733958784 00000100:00100000:2.0:1782216923.093429:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733958784 00000100:00100000:2.0:1782216923.093439:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733958528 00000100:00100000:2.0:1782216923.093441:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733958528 00000100:00100000:2.0:1782216923.093458:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782216923.093464:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868789733958912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216923.093488:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868789733958912:12345-0@lo:400:kworker.0 Request processed in 25us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216923.093494:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782216923.093503:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1782216923.093508:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6454abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868789733958784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216923.093525:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6454abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868789733958784:12345-0@lo:400:kworker.0 Request processed in 17us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216923.093530:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1782216923.093538:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1782216923.093542:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6454a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789733958528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216923.093562:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6454a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789733958528:12345-0@lo:400:kworker.0 Request processed in 19us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216923.093567:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1782216923.093589:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733959040 00000100:00100000:2.0:1782216923.093592:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733959040 00000100:00100000:2.0:1782216923.093611:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733958656 00000100:00100000:2.0:1782216923.093613:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733958656 00000100:00100000:2.0:1782216923.093628:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782216923.093632:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6454a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733959040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216923.093655:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6454a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733959040:12345-0@lo:400:kworker.0 Request processed in 22us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216923.093661:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782216923.093671:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782216923.093676:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6454a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733958656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216923.093706:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6454a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733958656:12345-0@lo:400:kworker.0 Request processed in 28us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216923.093714:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1782216923.093739:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782216923.093743:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782216923.093745:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782216923.093774:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67fff4380 x1868789733958656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216923.093787:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67fff4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733958656:0@lo:400:kworker.0 00000100:00100000:2.0:1782216923.093803:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67fff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789733958528:0@lo:400:kworker.0 00010000:00080000:2.0:1782216923.093816:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67fff7480 x1868789733959040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216923.093825:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67fff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733959040:0@lo:400:kworker.0 00000100:00100000:2.0:1782216923.093864:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67fff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1868789733958784:0@lo:400:kworker.0 00000100:00100000:2.0:1782216923.093917:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67fff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733958400:0@lo:400:kworker.0 00000100:00100000:2.0:1782216923.093929:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67fff6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1868789733958912:0@lo:400:kworker.0 00000100:00100000:1.0:1782216923.605987:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f62d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733959168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782216923.606091:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216923.606272:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733959168 00000100:00100000:3.0:1782216923.606282:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733959168 00000100:00100000:3.0:1782216923.606348:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782216923.606359:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67426ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733959168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782216923.606406:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782216923.606465:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67426ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733959168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216923.606474:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1782216923.606523:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67f62d880 x1868789733959168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216939 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216923.606546:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f62d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733959168:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782216923.732039:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216924.758848:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216925.781111:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216926.164148:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648546d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733959296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782216926.164234:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216926.164308:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733959296 00000100:00100000:0.0:1782216926.164315:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733959296 00000100:00100000:0.0:1782216926.164370:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782216926.164379:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648547100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733959296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782216926.164412:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782216926.164457:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648547100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733959296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216926.164471:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1782216926.164494:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782216926.164523:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e648546d80 x1868789733959296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216942 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216926.164542:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648546d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733959296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782216926.203168:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216926.203224:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216926.203289:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714002944 00000100:00100000:1.0:1782216926.203299:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714002944 00000100:00100000:1.0:1782216926.203369:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 55 00000100:00100000:1.0:1782216926.203379:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f62d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2357:x1868789714002944:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:1.0:1782216926.203449:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f62d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2357:x1868789714002944:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 71us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216926.203475:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 55 00000100:00100000:0.0:1782216926.203745:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714002816 00000100:00100000:0.0:1782216926.203751:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714002816 00000100:00100000:0.0:1782216926.203789:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 204 00000100:00100000:0.0:1782216926.203796:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:2357:x1868789714002816:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:0.0:1782216926.203829:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:2357:x1868789714002816:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 34us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216926.203834:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 204 00000100:00080000:3.0:1782216926.204203:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782216926.805592:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216927.835871:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216928.212660:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6454ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789733959552:0@lo:400:kworker.0 00000100:00100000:2.0:1782216928.212720:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216928.212786:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733959552 00000100:00100000:2.0:1782216928.212793:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733959552 00000100:00100000:2.0:1782216928.212844:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782216928.212853:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6454ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789733959552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216928.212920:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6454ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789733959552:12345-0@lo:400:kworker.0 Request processed in 68us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216928.212927:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782216928.212976:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6454ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789733959552:0@lo:400:kworker.0 00000100:00100000:2.0:1782216928.213007:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782216928.213024:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6454ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733959680:0@lo:400:kworker.0 00000100:00100000:2.0:1782216928.213050:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216928.213078:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733959680 00000100:00100000:2.0:1782216928.213082:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733959680 00000100:00100000:2.0:1782216928.213111:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1782216928.213118:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6454aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733959680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216928.213150:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6454aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733959680:12345-0@lo:400:kworker.0 Request processed in 33us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216928.213156:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1782216928.213187:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e6454ab480 x1868789733959680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216928.213204:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6454ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733959680:0@lo:400:kworker.0 00000100:00100000:2.0:1782216928.213246:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6454a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733960064:0@lo:400:kworker.0 00000100:00100000:2.0:1782216928.213268:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216928.213295:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733960064 00000100:00100000:2.0:1782216928.213299:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733960064 00000100:00100000:2.0:1782216928.213320:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1782216928.213326:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6454a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733960064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216928.213357:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6454a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733960064:12345-0@lo:400:kworker.0 Request processed in 30us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216928.213362:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1782216928.213385:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e6454a9f80 x1868789733960064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216928.213394:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6454a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733960064:0@lo:400:kworker.0 00000100:00100000:1.0:1782216928.213535:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6454ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1868789733959808:0@lo:400:kworker.0 00000100:00100000:1.0:1782216928.213563:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216928.213587:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1782216928.213593:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6454a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789733959424:0@lo:400:kworker.0 00000100:00100000:1.0:1782216928.213617:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216928.213634:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6454ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1868789733959936:0@lo:400:kworker.0 00000100:00100000:1.0:1782216928.213651:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216928.213674:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733959808 00000100:00100000:1.0:1782216928.213677:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733959808 00000100:00100000:1.0:1782216928.213696:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733959936 00000100:00100000:1.0:1782216928.213699:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733959936 00000100:00100000:1.0:1782216928.213714:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1782216928.213720:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67426f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868789733959808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216928.213751:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67426f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868789733959808:12345-0@lo:400:kworker.0 Request processed in 31us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216928.213757:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1782216928.213768:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1782216928.213774:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67426df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1868789733959936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216928.213797:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67426df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1868789733959936:12345-0@lo:400:kworker.0 Request processed in 23us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216928.213803:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1782216928.213824:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6454ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1868789733959936:0@lo:400:kworker.0 00000100:00100000:1.0:1782216928.213833:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6454ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1868789733959808:0@lo:400:kworker.0 00000100:00100000:2.0:1782216928.213944:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733959424 00000100:00100000:2.0:1782216928.213948:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733959424 00000100:00100000:2.0:1782216928.213973:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1782216928.213979:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+19:3303:x1868789733959424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216928.214281:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+19:3303:x1868789733959424:12345-0@lo:400:kworker.0 Request processed in 34us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216928.214288:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1782216928.214332:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6454a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789733959424:0@lo:400:kworker.0 00000100:00080000:3.0:1782216928.214538:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782216928.214543:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782216928.214545:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782216928.727210:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782216928.727234:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67426d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733960192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782216928.727302:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216928.728600:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733960192 00000100:00100000:0.0:1782216928.728612:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733960192 00000100:00100000:0.0:1782216928.728667:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782216928.728677:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67426e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733960192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782216928.728711:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782216928.728783:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67426e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733960192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (1481us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216928.728791:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1782216928.729331:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67426d180 x1868789733960192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216928.729351:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67426d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733960192:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782216928.871245:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216929.880081:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216930.901005:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216931.301583:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782216931.301607:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f62c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733960320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782216931.301677:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216931.310952:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733960320 00000100:00100000:3.0:1782216931.310964:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733960320 00000100:00100000:3.0:1782216931.311044:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782216931.311054:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733960320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782216931.311091:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782216931.311164:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733960320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (9487us total) trans 0 rc 0/0 00000100:00080000:0.0:1782216931.311262:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782216931.311308:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67f62c000 x1868789733960320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216947 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216931.311329:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f62c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733960320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782216931.312260:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782216931.323674:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216931.323754:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782216931.323825:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714003200 00000100:00100000:0.0:1782216931.323835:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714003200 00000100:00100000:0.0:1782216931.323947:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 59 00000100:00100000:0.0:1782216931.323958:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f62fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2358:x1868789714003200:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:0.0:1782216931.324028:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f62fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2358:x1868789714003200:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 72us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216931.324036:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 59 00000100:00080000:3.0:1782216931.324306:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782216931.324669:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714003072 00000100:00100000:2.0:1782216931.324686:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714003072 00000100:00100000:2.0:1782216931.324740:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 206 00000100:00100000:2.0:1782216931.324748:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:2358:x1868789714003072:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:2.0:1782216931.324797:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:2358:x1868789714003072:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 49us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216931.324804:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 206 00000001:02000400:2.0:1782216931.790444:0:9967:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 08:15:29 (1782216929) === 00010000:00010000:0.0:1782216931.924822:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782216932.169936:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216932.170130:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714003328 00000100:00100000:2.0:1782216932.170145:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714003328 00000100:00100000:2.0:1782216932.170342:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 207 00000100:00100000:2.0:1782216932.170354:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:8124:x1868789714003328:12345-192.168.203.19@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782216932.170377:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216932.170399:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e67a2d2000/0xf210a9075089ebd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6201b0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216932.170434:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e67a2d2000/0xf210a9075089ebd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6201b0 expref: 11 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216932.170447:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e67a2d2000/0xf210a9075089ebd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6201b0 expref: 11 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216932.170457:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67a2d2000, rc 0) 00000100:00100000:2.0:1782216932.170523:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+11:8124:x1868789714003328:12345-192.168.203.19@tcp:101:mount.lustre.0 Request processed in 170us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216932.170530:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 207 00000100:00100000:0.0:1782216932.176800:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216932.178239:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714003456 00000100:00100000:3.0:1782216932.178258:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714003456 00000100:00100000:3.0:1782216932.178351:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 208 00000100:00100000:3.0:1782216932.178364:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+11:8124:x1868789714003456:12345-192.168.203.19@tcp:501:mount.lustre.0 00000100:00100000:3.0:1782216932.179516:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+11:8124:x1868789714003456:12345-192.168.203.19@tcp:501:mount.lustre.0 Request processed in 701us (2277us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216932.179534:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 208 00000100:00100000:0.0:1782216932.187656:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216932.188055:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714003584 00000100:00100000:1.0:1782216932.188068:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714003584 00000100:00100000:1.0:1782216932.188205:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 209 00000100:00100000:1.0:1782216932.188218:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+11:8124:x1868789714003584:12345-192.168.203.19@tcp:503:mount.lustre.0 00000100:00100000:1.0:1782216932.191411:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+11:8124:x1868789714003584:12345-192.168.203.19@tcp:503:mount.lustre.0 Request processed in 3178us (3753us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216932.191430:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 209 00000100:00100000:1.0:1782216932.197848:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216932.198171:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714003712 00000100:00100000:2.0:1782216932.198186:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714003712 00000100:00100000:2.0:1782216932.198278:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 210 00000100:00100000:2.0:1782216932.198291:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+11:8128:x1868789714003712:12345-192.168.203.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782216932.201963:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+11:8128:x1868789714003712:12345-192.168.203.19@tcp:502:llog_process_th.0 Request processed in 3658us (4116us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216932.201983:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 210 00000100:00100000:0.0:1782216932.220008:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216932.221659:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714003840 00000100:00100000:1.0:1782216932.221686:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714003840 00000100:00100000:1.0:1782216932.221782:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 211 00000100:00100000:1.0:1782216932.221795:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+11:8128:x1868789714003840:12345-192.168.203.19@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782216932.222530:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+11:8128:x1868789714003840:12345-192.168.203.19@tcp:502:llog_process_th.0 Request processed in 732us (2533us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216932.222541:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 211 00000100:00100000:0.0:1782216932.228033:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216932.228838:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714003968 00000100:00100000:2.0:1782216932.228857:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714003968 00000100:00100000:2.0:1782216932.229150:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 212 00000100:00100000:2.0:1782216932.229165:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+11:8124:x1868789714003968:12345-192.168.203.19@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782216932.229197:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216932.229222:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e67a2d3c00/0xf210a9075089ebdb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6201da expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216932.229258:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e67a2d3c00/0xf210a9075089ebdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6201da expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216932.229271:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e67a2d3c00/0xf210a9075089ebdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6201da expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216932.229282:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67a2d3c00, rc 0) 00000100:00100000:2.0:1782216932.229370:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+12:8124:x1868789714003968:12345-192.168.203.19@tcp:101:mount.lustre.0 Request processed in 208us (1347us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216932.229379:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 212 00000100:00100000:3.0:1782216932.249352:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216932.249537:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714004096 00000100:00100000:1.0:1782216932.249558:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714004096 00000100:00100000:1.0:1782216932.249793:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 213 00000100:00100000:1.0:1782216932.249806:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+12:8124:x1868789714004096:12345-192.168.203.19@tcp:256:mount.lustre.0 20000000:01000000:1.0:1782216932.249842:0:5776:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1782216932.249933:0:5776:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1782216932.249946:0:5776:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1782216932.249949:0:5776:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1782216932.249952:0:5776:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1782216932.256937:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+12:8124:x1868789714004096:12345-192.168.203.19@tcp:256:mount.lustre.0 Request processed in 7122us (7587us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216932.256952:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 213 00000100:00100000:0.0:1782216932.261128:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216932.262757:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714004224 00000100:00100000:2.0:1782216932.262778:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714004224 00000100:00100000:2.0:1782216932.262866:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 214 00000100:00100000:2.0:1782216932.262930:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+12:8124:x1868789714004224:12345-192.168.203.19@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782216932.262972:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216932.263000:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e67a2d2a00/0xf210a9075089ebe2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6201e1 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216932.263037:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e67a2d2a00/0xf210a9075089ebe2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6201e1 expref: 13 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216932.263051:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e67a2d2a00/0xf210a9075089ebe2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6201e1 expref: 13 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216932.263060:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67a2d2a00, rc 0) 00000100:00100000:2.0:1782216932.263152:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:8124:x1868789714004224:12345-192.168.203.19@tcp:101:mount.lustre.0 Request processed in 275us (2032us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216932.263161:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 214 00000100:00100000:3.0:1782216932.271802:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216932.271943:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714004352 00000100:00100000:1.0:1782216932.271955:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714004352 00000100:00100000:1.0:1782216932.272017:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 215 00000100:00100000:1.0:1782216932.272027:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:8124:x1868789714004352:12345-192.168.203.19@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782216932.272414:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:8124:x1868789714004352:12345-192.168.203.19@tcp:501:mount.lustre.0 Request processed in 380us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216932.272422:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 215 00000100:00100000:0.0:1782216932.283894:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216932.284170:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714004480 00000100:00100000:3.0:1782216932.284180:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714004480 00000100:00100000:3.0:1782216932.284226:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 216 00000100:00100000:3.0:1782216932.284235:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:8124:x1868789714004480:12345-192.168.203.19@tcp:503:mount.lustre.0 00000100:00100000:3.0:1782216932.284516:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:8124:x1868789714004480:12345-192.168.203.19@tcp:503:mount.lustre.0 Request processed in 281us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216932.284525:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 216 00000100:00100000:0.0:1782216932.290821:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216932.290921:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714004608 00000100:00100000:2.0:1782216932.290931:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714004608 00000100:00100000:2.0:1782216932.290979:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 217 00000100:00100000:2.0:1782216932.290989:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:8134:x1868789714004608:12345-192.168.203.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782216932.291247:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:8134:x1868789714004608:12345-192.168.203.19@tcp:502:llog_process_th.0 Request processed in 255us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216932.291386:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 217 00000100:00100000:0.0:1782216932.297517:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216932.297608:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714004736 00000100:00100000:1.0:1782216932.297618:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714004736 00000100:00100000:1.0:1782216932.297669:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 218 00000100:00100000:1.0:1782216932.297680:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:8134:x1868789714004736:12345-192.168.203.19@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782216932.297950:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:8134:x1868789714004736:12345-192.168.203.19@tcp:502:llog_process_th.0 Request processed in 272us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216932.297959:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 218 00000100:00100000:0.0:1782216932.302967:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782216932.303009:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782216932.303036:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714004864 00000100:00100000:0.0:1782216932.303056:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714004864 00000100:00100000:0.0:1782216932.303092:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714005248 00000100:00100000:0.0:1782216932.303095:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714005248 00000100:00100000:0.0:1782216932.303125:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 60 00000100:00100000:0.0:1782216932.303136:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2359:x1868789714005248:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:0.0:1782216932.303221:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2359:x1868789714005248:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 87us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216932.303228:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 60 00000100:00100000:0.0:1782216932.303245:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 10 00000100:00100000:0.0:1782216932.303373:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648545f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2355:x1868789714004864:12345-192.168.203.19@tcp:38:mount.lustre.0 00010000:00080000:0.0:1782216932.303395:0:5785:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb@192.168.203.19@tcp t0 exp 0000000000000000 cur 251 last 0 00000020:00000080:0.0:1782216932.303428:0:5785:0:(genops.c:1406:class_connect()) connect: client e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb, cookie 0xf210a9075089ebe9 00000004:00100000:0.0:1782216932.303459:0:5785:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1782216932.303714:0:5785:0:(import.c:65:import_set_state_nolock()) ffff88e67418c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782216932.303747:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648545f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+6:2355:x1868789714004864:12345-192.168.203.19@tcp:38:mount.lustre.0 Request processed in 495us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216932.303753:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 10 00000100:00100000:0.0:1782216932.315079:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216932.315160:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714004992 00000100:00100000:2.0:1782216932.315172:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714004992 00000100:00100000:0.0:1782216932.315260:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216932.315261:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 11 00000100:00100000:2.0:1782216932.315271:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648544700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+6:0:x1868789714004992:12345-192.168.203.19@tcp:41:mount.lustre.0 00000100:00100000:0.0:1782216932.315287:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714005120 00000100:00100000:0.0:1782216932.315291:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714005120 00000100:00100000:0.0:1782216932.315316:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 12 00000004:00000024:2.0:1782216932.315317:0:5785:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1782216932.315322:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648547b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+7:8124:x1868789714005120:12345-192.168.203.19@tcp:41:mount.lustre.0 00000004:00000024:0.0:1782216932.315333:0:5783:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1782216932.315403:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648544700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+7:0:x1868789714004992:12345-192.168.203.19@tcp:41:mount.lustre.0 Request processed in 133us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216932.315411:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 11 00000100:00080000:3.0:1782216932.316433:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782216932.316812:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648547b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+6:8124:x1868789714005120:12345-192.168.203.19@tcp:41:mount.lustre.0 Request processed in 1484us (1546us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216932.316823:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 12 00000100:00100000:0.0:1782216932.331077:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216932.331285:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714005376 00000100:00100000:2.0:1782216932.331295:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714005376 00000100:00100000:2.0:1782216932.331355:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 13 00000100:00100000:2.0:1782216932.331364:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648544e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+6:8124:x1868789714005376:12345-192.168.203.19@tcp:40:mount.lustre.0 00000100:00100000:2.0:1782216932.331458:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648544e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+6:8124:x1868789714005376:12345-192.168.203.19@tcp:40:mount.lustre.0 Request processed in 94us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216932.331466:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 13 00000100:00100000:2.0:1782216932.342436:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216932.342481:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216932.342518:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216932.342548:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714005504 00000100:00100000:2.0:1782216932.342557:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714005504 00000100:00100000:2.0:1782216932.342601:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714005632 00000100:00100000:2.0:1782216932.342604:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714005632 00000100:00100000:2.0:1782216932.342625:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 13 00000100:00100000:2.0:1782216932.342632:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6454a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2355:x1868789714005504:12345-192.168.203.19@tcp:8:mount.lustre.0 00010000:00080000:2.0:1782216932.342837:0:7991:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb@192.168.203.19@tcp t0 exp 0000000000000000 cur 251 last 0 00000020:00000080:2.0:1782216932.342870:0:7991:0:(genops.c:1406:class_connect()) connect: client e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb, cookie 0xf210a9075089ebf0 00002000:00100000:2.0:1782216932.342924:0:7991:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb/ffff88e6755cc800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782216932.342935:0:7991:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782216932.343271:0:7991:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1782216932.343303:0:7991:0:(import.c:65:import_set_state_nolock()) ffff88e6755cb800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782216932.343362:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6454a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+6:2355:x1868789714005504:12345-192.168.203.19@tcp:8:mount.lustre.0 Request processed in 729us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216932.343383:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 13 00000100:00100000:2.0:1782216932.343421:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 14 00000100:00100000:2.0:1782216932.343426:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6454a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2355:x1868789714005632:12345-192.168.203.19@tcp:8:mount.lustre.0 00010000:00080000:2.0:1782216932.343454:0:7991:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb@192.168.203.19@tcp t0 exp 0000000000000000 cur 251 last 0 00000020:00000080:2.0:1782216932.343470:0:7991:0:(genops.c:1406:class_connect()) connect: client e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb, cookie 0xf210a9075089ebf7 00002000:00100000:2.0:1782216932.343475:0:7991:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb/ffff88e6755ce000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782216932.343489:0:7991:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1782216932.344296:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714005760 00000100:00100000:0.0:1782216932.344305:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714005760 00000100:00100000:0.0:1782216932.344353:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 1 00000100:00100000:0.0:1782216932.344361:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6454a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+6:8124:x1868789714005760:12345-192.168.203.19@tcp:33:mount.lustre.0 00002000:00080000:2.0:1782216932.347929:0:7991:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1782216932.347985:0:7991:0:(import.c:65:import_set_state_nolock()) ffff88e6755ce800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782216932.348057:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6454a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+6:2355:x1868789714005632:12345-192.168.203.19@tcp:8:mount.lustre.0 Request processed in 4627us (5536us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216932.348069:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 14 00000004:00200000:1.0:1782216932.358174:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1782216932.358567:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6454a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+6:8124:x1868789714005760:12345-192.168.203.19@tcp:33:mount.lustre.0 Request processed in 14199us (16134us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216932.358601:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 1 00010000:00010000:2.0:1782216932.948863:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216933.337110:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6454aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733960448:0@lo:400:kworker.0 00000100:00100000:2.0:1782216933.337177:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216933.337217:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6454aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1868789733960960:0@lo:400:kworker.0 00000100:00100000:2.0:1782216933.337242:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216933.337265:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782216933.337270:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6454aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1868789733960832:0@lo:400:kworker.0 00000100:00100000:2.0:1782216933.337290:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216933.337317:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6454a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789733960576:0@lo:400:kworker.0 00000100:00100000:2.0:1782216933.337340:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216933.337355:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6454a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733961088:0@lo:400:kworker.0 00000100:00100000:2.0:1782216933.337386:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216933.338006:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733960960 00000100:00100000:1.0:1782216933.338015:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733960960 00000100:00100000:1.0:1782216933.338065:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733960832 00000100:00100000:1.0:1782216933.338068:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733960832 00000100:00100000:1.0:1782216933.338083:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733960576 00000100:00100000:1.0:1782216933.338085:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733960576 00000100:00100000:1.0:1782216933.338101:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1782216933.338110:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6454ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868789733960960:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1782216933.338239:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782216933.338938:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733960448 00000100:00100000:0.0:1782216933.338953:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733960448 00000100:00100000:0.0:1782216933.338987:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1782216933.338996:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+19:3304:x1868789733960448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216933.340104:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733961088 00000100:00100000:3.0:1782216933.340111:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733961088 00000100:00100000:3.0:1782216933.340158:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782216933.340167:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733961088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216933.340282:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6454ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868789733960960:12345-0@lo:400:kworker.0 Request processed in 2171us (3036us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216933.340292:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1782216933.340312:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1782216933.340321:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6454ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868789733960832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216933.340352:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6454ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868789733960832:12345-0@lo:400:kworker.0 Request processed in 33us (3061us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216933.340358:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1782216933.340370:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1782216933.340376:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fff6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789733960576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216933.340418:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fff6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789733960576:12345-0@lo:400:kworker.0 Request processed in 42us (3076us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216933.340424:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1782216933.340447:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6454a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733960704:0@lo:400:kworker.0 00000100:00100000:1.0:1782216933.340493:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216933.340533:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733960704 00000100:00100000:1.0:1782216933.340537:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733960704 00000100:00100000:1.0:1782216933.340571:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782216933.340578:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67426d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733960704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216933.340612:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67426d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733960704:12345-0@lo:400:kworker.0 Request processed in 34us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216933.340618:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1782216933.340648:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e6454a9180 x1868789733960704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216933.340662:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6454a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733960704:0@lo:400:kworker.0 00000100:00100000:2.0:1782216933.341636:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6454a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789733960576:0@lo:400:kworker.0 00000100:00100000:0.0:1782216933.343046:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+19:3304:x1868789733960448:12345-0@lo:400:kworker.0 Request processed in 4046us (5863us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216933.343059:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1782216933.350043:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733961088:12345-0@lo:400:kworker.0 Request processed in 9867us (12645us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216933.350058:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1782216933.350098:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782216933.350102:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1782216933.350679:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e6454a8e00 x1868789733961088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216933.350696:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6454a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733961088:0@lo:400:kworker.0 00000100:00100000:1.0:1782216933.351235:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6454aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1868789733960832:0@lo:400:kworker.0 00000100:00100000:1.0:1782216933.351247:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6454aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733960448:0@lo:400:kworker.0 00000100:00100000:1.0:1782216933.351257:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6454aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1868789733960960:0@lo:400:kworker.0 00000001:00100000:1.0:1782216933.449622:0:6609:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb 00000100:00100000:3.0:1782216933.845182:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782216933.845206:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67426ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733961216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782216933.845270:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216933.845355:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733961216 00000100:00100000:1.0:1782216933.845362:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733961216 00000100:00100000:1.0:1782216933.845414:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782216933.845423:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f62dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733961216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782216933.845445:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782216933.845489:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f62dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733961216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216933.845496:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1782216933.845542:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67426ce00 x1868789733961216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216949 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216933.845560:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67426ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733961216:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782216933.975663:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216935.000919:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1782216935.443837:0:8321:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb 00010000:00010000:1.0:1782216936.022683:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216936.404207:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f62c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733961344:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782216936.404282:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216936.404403:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733961344 00000100:00100000:3.0:1782216936.404415:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733961344 00000100:00100000:3.0:1782216936.404486:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782216936.404494:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733961344:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782216936.404605:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1782216936.404629:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782216936.404675:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733961344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 181us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216936.404682:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1782216936.404723:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67f62c380 x1868789733961344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216952 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216936.404743:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f62c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733961344:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1782216936.432354:0:7488:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb 00010000:00010000:2.0:1782216937.048016:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782216937.469763:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216937.469810:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216937.469837:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216937.469859:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216937.469915:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714006144 00000100:00100000:1.0:1782216937.469924:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714006144 00000100:00100000:1.0:1782216937.469980:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714006016 00000100:00100000:1.0:1782216937.469984:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714006016 00000100:00100000:1.0:1782216937.470007:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 64 00000100:00100000:1.0:1782216937.470016:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67426ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2357:x1868789714006144:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:1.0:1782216937.470086:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67426ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2357:x1868789714006144:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 70us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216937.470094:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 64 00000100:00100000:1.0:1782216937.470113:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 65 00000100:00100000:1.0:1782216937.470120:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67426c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2357:x1868789714006016:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:1.0:1782216937.470146:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67426c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2357:x1868789714006016:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 26us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216937.470152:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 65 00000100:00100000:1.0:1782216937.470454:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714006400 00000100:00100000:1.0:1782216937.470473:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714006400 00000100:00100000:1.0:1782216937.470505:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 37 00000100:00100000:1.0:1782216937.470513:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67426e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2357:x1868789714006400:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:1.0:1782216937.470541:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67426e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2357:x1868789714006400:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 29us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216937.470547:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 37 00000100:00080000:1.0:1782216937.470566:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782216937.470570:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782216937.470954:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714005888 00000100:00100000:3.0:1782216937.470959:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714005888 00000100:00100000:3.0:1782216937.470991:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 220 00000100:00100000:3.0:1782216937.470998:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2357:x1868789714005888:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:3.0:1782216937.471034:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2357:x1868789714005888:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 37us (1280us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216937.471041:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 220 00000100:00100000:1.0:1782216937.475918:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216937.475986:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714006272 00000100:00100000:3.0:1782216937.475994:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714006272 00000100:00100000:3.0:1782216937.476065:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 38 00000100:00100000:3.0:1782216937.476074:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67426d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2357:x1868789714006272:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:3.0:1782216937.476151:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67426d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2357:x1868789714006272:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 79us (242us total) trans 0 rc 0/0 00000100:00080000:1.0:1782216937.476238:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782216937.476488:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 38 00010000:00010000:1.0:1782216938.068124:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782216938.115313:0:10167:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg319-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:0.0:1782216938.460855:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648469c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789733961600:0@lo:400:kworker.0 00000100:00100000:0.0:1782216938.460974:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216938.461185:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733962112:0@lo:400:kworker.0 00000100:00100000:0.0:1782216938.461215:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216938.461249:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782216938.461256:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648468000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733961728:0@lo:400:kworker.0 00000100:00100000:0.0:1782216938.461284:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216938.461315:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733961600 00000100:00100000:0.0:1782216938.461322:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733961600 00000100:00100000:0.0:1782216938.461368:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782216938.461377:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789733961600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216938.461429:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789733961600:12345-0@lo:400:kworker.0 Request processed in 52us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216938.461436:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782216938.461460:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733962112 00000100:00100000:0.0:1782216938.461464:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733962112 00000100:00100000:0.0:1782216938.461504:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733961728 00000100:00100000:0.0:1782216938.461508:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733961728 00000100:00100000:0.0:1782216938.461529:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1782216938.461540:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733962112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216938.461573:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733962112:12345-0@lo:400:kworker.0 Request processed in 38us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216938.461593:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1782216938.461605:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1782216938.461611:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a51b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733961728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216938.461641:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a51b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733961728:12345-0@lo:400:kworker.0 Request processed in 30us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216938.461646:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1782216938.461849:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e648468000 x1868789733961728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216938.461875:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648468000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733961728:0@lo:400:kworker.0 00000100:00100000:0.0:1782216938.461909:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648469c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789733961600:0@lo:400:kworker.0 00010000:00080000:0.0:1782216938.461920:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67a1f2d80 x1868789733962112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216938.462167:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733962112:0@lo:400:kworker.0 00000100:00080000:0.0:1782216938.462195:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782216938.462199:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782216938.462267:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648545c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733961472:0@lo:400:kworker.0 00000100:00100000:2.0:1782216938.462303:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216938.462334:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1868789733961984:0@lo:400:kworker.0 00000100:00100000:2.0:1782216938.462356:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216938.462380:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782216938.462385:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1868789733961856:0@lo:400:kworker.0 00000100:00100000:2.0:1782216938.462404:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216938.462440:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733961984 00000100:00100000:2.0:1782216938.462444:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733961984 00000100:00100000:2.0:1782216938.462485:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733961856 00000100:00100000:2.0:1782216938.462488:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733961856 00000100:00100000:1.0:1782216938.462522:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1782216938.462551:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fff7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868789733961984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216938.462567:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733961472 00000100:00100000:0.0:1782216938.462573:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733961472 00000100:00100000:0.0:1782216938.462607:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1782216938.462617:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+19:3304:x1868789733961472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216938.463573:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1782216938.463592:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fff5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868789733961856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216938.463618:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fff7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868789733961984:12345-0@lo:400:kworker.0 Request processed in 1074us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216938.463632:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1782216938.463640:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fff5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868789733961856:12345-0@lo:400:kworker.0 Request processed in 48us (1232us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216938.463648:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1782216938.463672:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782216938.463726:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1868789733961856:0@lo:400:kworker.0 00000100:00100000:2.0:1782216938.463736:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648545c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733961472:0@lo:400:kworker.0 00000100:00100000:2.0:1782216938.463745:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1868789733961984:0@lo:400:kworker.0 00000100:00100000:0.0:1782216938.463798:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+19:3304:x1868789733961472:12345-0@lo:400:kworker.0 Request processed in 1182us (1493us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216938.463804:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1782216938.964079:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67426d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733962240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782216938.964148:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216938.964381:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733962240 00000100:00100000:3.0:1782216938.964389:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733962240 00000100:00100000:3.0:1782216938.964436:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782216938.964446:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fff4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733962240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782216938.964478:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782216938.970652:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fff4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733962240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6198us (6494us total) trans 0 rc 0/0 00010000:00080000:2.0:1782216938.971542:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67426d880 x1868789733962240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216954 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216938.971564:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67426d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733962240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782216938.974268:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:2.0:1782216939.092243:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216940.118983:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216941.142179:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216941.524594:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67fff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733962368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782216941.524668:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216941.524819:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733962368 00000100:00100000:2.0:1782216941.524829:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733962368 00000100:00100000:2.0:1782216941.524909:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1782216941.524917:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733962368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782216941.524949:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782216941.524990:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733962368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216941.525013:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1782216941.525031:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782216941.525057:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67fff5500 x1868789733962368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216957 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216941.525075:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67fff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733962368:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782216942.164098:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216942.596282:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216942.596318:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216942.596343:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216942.596362:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216942.596397:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216942.596424:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714006656 00000100:00100000:2.0:1782216942.596433:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714006656 00000100:00100000:2.0:1782216942.596480:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714006784 00000100:00100000:2.0:1782216942.596482:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714006784 00000100:00100000:2.0:1782216942.596501:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 69 00000100:00100000:2.0:1782216942.596509:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fff5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2356:x1868789714006656:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:2.0:1782216942.596578:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fff5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2356:x1868789714006656:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 68us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216942.596586:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 69 00000100:00100000:2.0:1782216942.596601:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 70 00000100:00100000:2.0:1782216942.596608:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2357:x1868789714006784:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:2.0:1782216942.596634:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2357:x1868789714006784:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 27us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216942.596640:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 70 00000100:00100000:2.0:1782216942.596658:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714006912 00000100:00100000:2.0:1782216942.596667:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714006912 00000100:00100000:2.0:1782216942.596693:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714007040 00000100:00100000:2.0:1782216942.596696:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714007040 00000100:00100000:2.0:1782216942.596717:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 41 00000100:00100000:2.0:1782216942.596723:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2357:x1868789714006912:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:2.0:1782216942.596749:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2357:x1868789714006912:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 26us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216942.596755:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 41 00000100:00100000:2.0:1782216942.596765:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 42 00000100:00100000:2.0:1782216942.596771:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f75b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2357:x1868789714007040:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:2.0:1782216942.596792:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f75b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2357:x1868789714007040:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 21us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216942.596797:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 42 00000100:00080000:2.0:1782216942.596819:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782216942.596822:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782216942.596825:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782216942.597029:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714006528 00000100:00100000:1.0:1782216942.597034:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714006528 00000100:00100000:1.0:1782216942.597068:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 222 00000100:00100000:1.0:1782216942.597075:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2356:x1868789714006528:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:1.0:1782216942.597109:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2356:x1868789714006528:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 34us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216942.597116:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 222 00010000:00010000:0.0:1782216943.188109:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216943.572489:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f75aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1868789733962880:0@lo:400:kworker.0 00000100:00100000:1.0:1782216943.572489:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f759f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733962496:0@lo:400:kworker.0 00000100:00100000:1.0:1782216943.580178:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216943.580242:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f759500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1868789733963008:0@lo:400:kworker.0 00000100:00100000:1.0:1782216943.580274:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216943.580325:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f758a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789733962624:0@lo:400:kworker.0 00000100:00100000:1.0:1782216943.580349:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216943.580365:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f759180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733963136:0@lo:400:kworker.0 00000100:00100000:1.0:1782216943.580387:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216943.580404:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782216943.580410:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f758380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733962752:0@lo:400:kworker.0 00000100:00100000:1.0:1782216943.580430:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216943.580454:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733963136 00000100:00100000:0.0:1782216943.580462:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733963136 00000100:00100000:1.0:1782216943.580464:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733962496 00000100:00100000:1.0:1782216943.580467:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733962496 00000100:00100000:0.0:1782216943.580496:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733962752 00000100:00100000:0.0:1782216943.580499:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733962752 00000100:00100000:1.0:1782216943.580500:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1782216943.580506:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+19:3304:x1868789733962496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216943.580517:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1782216943.580522:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67426d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733963136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216943.580554:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+19:3304:x1868789733962496:12345-0@lo:400:kworker.0 Request processed in 47us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216943.580554:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67426d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733963136:12345-0@lo:400:kworker.0 Request processed in 32us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216943.580561:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1782216943.580561:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1782216943.580575:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1782216943.580580:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67426d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733962752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216943.580594:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733963008 00000100:00100000:1.0:1782216943.580597:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733963008 00000100:00100000:0.0:1782216943.580606:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67426d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733962752:12345-0@lo:400:kworker.0 Request processed in 26us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216943.580611:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1782216943.580619:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733962624 00000100:00100000:1.0:1782216943.580622:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733962624 00000100:00100000:1.0:1782216943.580640:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1782216943.580647:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67426d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868789733963008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216943.580676:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67426d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868789733963008:12345-0@lo:400:kworker.0 Request processed in 30us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216943.580682:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1782216943.580695:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782216943.580700:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67426e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789733962624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216943.580732:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67426e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789733962624:12345-0@lo:400:kworker.0 Request processed in 32us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216943.580739:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:1.0:1782216943.580786:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67f758380 x1868789733962752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216943.580812:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f758380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733962752:0@lo:400:kworker.0 00000100:00100000:1.0:1782216943.580834:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f758a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789733962624:0@lo:400:kworker.0 00010000:00080000:1.0:1782216943.580844:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67f759180 x1868789733963136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216943.580852:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f759180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733963136:0@lo:400:kworker.0 00000100:00100000:1.0:1782216943.580900:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f759f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733962496:0@lo:400:kworker.0 00000100:00100000:1.0:1782216943.580909:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f759500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1868789733963008:0@lo:400:kworker.0 00000100:00080000:1.0:1782216943.581013:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782216943.581017:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782216943.581356:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782216943.582523:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216943.582619:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733962880 00000100:00100000:1.0:1782216943.582627:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733962880 00000100:00100000:1.0:1782216943.582679:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1782216943.582687:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f75a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868789733962880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216943.582736:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f75a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868789733962880:12345-0@lo:400:kworker.0 Request processed in 49us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216943.582743:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1782216943.582961:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782216943.582988:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f75aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1868789733962880:0@lo:400:kworker.0 00000100:00100000:2.0:1782216944.084650:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6454a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733963264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782216944.084721:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216944.084856:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733963264 00000100:00100000:0.0:1782216944.084864:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733963264 00000100:00100000:0.0:1782216944.084939:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1782216944.084949:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f75aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733963264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782216944.084983:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782216944.085026:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f75aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733963264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216944.085033:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1782216944.085170:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e6454a9880 x1868789733963264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216960 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216944.085209:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6454a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733963264:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782216944.212031:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216945.236449:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216946.262611:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782216946.654057:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f75a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733963392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782216946.654151:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216946.654242:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733963392 00000100:00100000:1.0:1782216946.654252:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733963392 00000100:00080000:2.0:1782216946.654330:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782216946.654332:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782216946.654345:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6454a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733963392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782216946.654390:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782216946.654451:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6454a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733963392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216946.654462:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1782216946.654907:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67f75a300 x1868789733963392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216962 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216946.654952:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f75a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733963392:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782216947.287246:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216947.708646:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216947.708702:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782216947.709538:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714007296 00000100:00100000:0.0:1782216947.709552:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714007296 00000100:00100000:0.0:1782216947.709653:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 74 00000100:00100000:0.0:1782216947.709667:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f75a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2357:x1868789714007296:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:0.0:1782216947.709776:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f75a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2357:x1868789714007296:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 112us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216947.709785:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 74 00000100:00100000:3.0:1782216947.709970:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714007168 00000100:00100000:3.0:1782216947.709977:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714007168 00000100:00100000:3.0:1782216947.710010:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 224 00000100:00100000:3.0:1782216947.710017:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2357:x1868789714007168:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:3.0:1782216947.710047:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2357:x1868789714007168:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 31us (1413us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216947.710053:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 224 00000100:00080000:2.0:1782216947.711092:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782216947.715318:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216947.715380:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714007424 00000100:00100000:2.0:1782216947.715384:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216947.715394:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714007424 00000100:00100000:3.0:1782216947.715494:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 75 00000100:00100000:3.0:1782216947.715506:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f758e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2357:x1868789714007424:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:3.0:1782216947.715614:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f758e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2357:x1868789714007424:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 110us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216947.715628:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 75 00000100:00080000:2.0:1782216947.715801:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782216947.716925:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714007552 00000100:00100000:0.0:1782216947.716940:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714007552 00000100:00080000:2.0:1782216947.717018:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782216947.717032:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 45 00000100:00100000:0.0:1782216947.717044:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f75bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2357:x1868789714007552:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:0.0:1782216947.717141:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f75bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2357:x1868789714007552:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 98us (1757us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216947.717149:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 45 00000100:00100000:2.0:1782216947.717806:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216947.719406:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714007680 00000100:00100000:3.0:1782216947.719426:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714007680 00000100:00080000:0.0:1782216947.719487:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782216947.719518:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 46 00000100:00100000:3.0:1782216947.719531:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f758700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2356:x1868789714007680:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:3.0:1782216947.719766:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f758700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2356:x1868789714007680:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 236us (1972us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216947.719784:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 46 00010000:00010000:2.0:1782216948.309918:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216948.692534:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6454a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733963520:0@lo:400:kworker.0 00000100:00100000:3.0:1782216948.692658:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216948.693577:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6454a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1868789733963904:0@lo:400:kworker.0 00000100:00100000:2.0:1782216948.693636:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216948.693697:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733963904 00000100:00100000:2.0:1782216948.693706:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733963904 00000100:00100000:2.0:1782216948.693767:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1782216948.693777:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868789733963904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216948.693843:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868789733963904:12345-0@lo:400:kworker.0 Request processed in 67us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216948.693850:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1782216948.693872:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782216948.693919:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6454a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1868789733963904:0@lo:400:kworker.0 00000100:00100000:2.0:1782216948.693961:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6454aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789733963648:0@lo:400:kworker.0 00000100:00100000:2.0:1782216948.693983:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216948.694000:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782216948.694005:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6454a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733963776:0@lo:400:kworker.0 00000100:00100000:2.0:1782216948.694046:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216948.694070:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733963648 00000100:00100000:2.0:1782216948.694074:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733963648 00000100:00100000:2.0:1782216948.694094:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1782216948.694100:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f759c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789733963648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216948.694138:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f759c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789733963648:12345-0@lo:400:kworker.0 Request processed in 28us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216948.694145:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1782216948.694162:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733963776 00000100:00100000:2.0:1782216948.694164:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733963776 00000100:00100000:2.0:1782216948.694192:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1782216948.694197:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f758000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733963776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216948.694232:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f758000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733963776:12345-0@lo:400:kworker.0 Request processed in 35us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216948.694238:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1782216948.694257:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782216948.694272:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e6454a8a80 x1868789733963776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216948.694283:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6454a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733963776:0@lo:400:kworker.0 00000100:00100000:2.0:1782216948.694300:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6454aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789733963648:0@lo:400:kworker.0 00000100:00100000:0.0:1782216948.695298:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733963520 00000100:00100000:0.0:1782216948.695309:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733963520 00000100:00100000:0.0:1782216948.695358:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1782216948.695366:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+19:3304:x1868789733963520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216948.702151:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6454aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733964160:0@lo:400:kworker.0 00000100:00100000:2.0:1782216948.702401:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782216948.702418:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6454a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1868789733964032:0@lo:400:kworker.0 00000100:00100000:0.0:1782216948.706700:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+19:3304:x1868789733963520:12345-0@lo:400:kworker.0 Request processed in 11318us (14026us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216948.706718:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1782216948.712483:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216948.712491:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216948.712568:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733964032 00000100:00100000:0.0:1782216948.712581:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733964032 00000100:00100000:0.0:1782216948.712662:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1782216948.712673:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f75b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1868789733964032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216948.712858:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6454a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733963520:0@lo:400:kworker.0 00000100:00100000:3.0:1782216948.712957:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733964160 00000100:00100000:3.0:1782216948.712962:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733964160 00000100:00100000:3.0:1782216948.712999:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782216948.713007:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6454aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733964160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216948.715993:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f75b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1868789733964032:12345-0@lo:400:kworker.0 Request processed in 3307us (3507us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216948.716011:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1782216948.716061:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782216948.716073:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782216948.716122:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6454a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1868789733964032:0@lo:400:kworker.0 00000100:00100000:3.0:1782216948.718905:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6454aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733964160:12345-0@lo:400:kworker.0 Request processed in 5886us (6400us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216948.718923:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1782216948.721583:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e6454aa300 x1868789733964160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216948.721607:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6454aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733964160:0@lo:400:kworker.0 00000100:00100000:3.0:1782216949.215864:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782216949.215909:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f62ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733964288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782216949.216111:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216949.220096:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733964288 00000100:00100000:2.0:1782216949.220114:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733964288 00000100:00100000:2.0:1782216949.220182:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782216949.220205:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f62e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733964288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782216949.220255:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782216949.220372:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f62e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733964288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 169us (4261us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216949.220380:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1782216949.220443:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67f62ea00 x1868789733964288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216965 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216949.220468:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f62ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733964288:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782216949.333287:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216950.356251:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216951.382633:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216951.767323:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f75b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733964416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782216951.767388:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216951.767457:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733964416 00000100:00100000:2.0:1782216951.767464:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733964416 00000100:00100000:2.0:1782216951.767525:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1782216951.767532:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782216951.767535:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f75ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733964416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782216951.767571:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782216951.767621:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f75ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733964416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216951.767628:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1782216951.767678:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67f75b800 x1868789733964416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216967 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216951.767698:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f75b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733964416:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782216952.407515:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216952.829467:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216952.831633:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714007808 00000100:00100000:3.0:1782216952.831735:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714007808 00000100:00100000:3.0:1782216952.831815:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 226 00000100:00100000:3.0:1782216952.831826:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2358:x1868789714007808:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:0.0:1782216952.833162:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2358:x1868789714007808:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 1330us (3696us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216952.833173:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 226 00000100:00100000:0.0:1782216952.839980:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782216952.840024:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782216952.840057:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782216952.840093:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216952.840217:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714008192 00000100:00100000:3.0:1782216952.840227:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714008192 00000100:00100000:3.0:1782216952.840295:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714008320 00000100:00100000:3.0:1782216952.840299:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714008320 00000100:00100000:3.0:1782216952.840323:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 15 00000100:00100000:3.0:1782216952.840332:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2355:x1868789714008192:12345-192.168.203.19@tcp:9:kworker.0 00000020:00000080:3.0:1782216952.840363:0:6579:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf210a9075089ebf0 00000100:00080000:3.0:1782216952.840370:0:6579:0:(import.c:65:import_set_state_nolock()) ffff88e6755cb800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782216952.840405:0:6579:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1782216952.840721:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+2:2355:x1868789714008192:12345-192.168.203.19@tcp:9:kworker.0 Request processed in 389us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216952.840728:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 15 00000100:00100000:3.0:1782216952.840764:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 16 00000100:00100000:3.0:1782216952.840772:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2355:x1868789714008320:12345-192.168.203.19@tcp:9:kworker.0 00000020:00000080:3.0:1782216952.840784:0:6579:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf210a9075089ebf7 00000100:00080000:3.0:1782216952.840788:0:6579:0:(import.c:65:import_set_state_nolock()) ffff88e6755ce800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782216952.840808:0:6579:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1782216952.840916:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714007936 00000100:00100000:2.0:1782216952.840922:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714007936 00000100:00100000:2.0:1782216952.840954:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714008064 00000100:00100000:2.0:1782216952.840958:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714008064 00000100:00100000:2.0:1782216952.840980:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 79 00000100:00100000:2.0:1782216952.841000:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2358:x1868789714007936:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:2.0:1782216952.841035:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2358:x1868789714007936:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 36us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216952.841042:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 79 00000100:00100000:2.0:1782216952.841059:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 80 00000100:00100000:2.0:1782216952.841067:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2359:x1868789714008064:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:2.0:1782216952.841109:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2359:x1868789714008064:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 30us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216952.841117:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 80 00010000:00010000:2.0:1782216952.841167:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216952.841168:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+2:2355:x1868789714008320:12345-192.168.203.19@tcp:9:kworker.0 Request processed in 395us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216952.841178:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 16 00010000:00010000:3.0:1782216952.841196:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782216952.842553:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782216952.842561:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782216952.842564:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782216953.428040:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216953.813775:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f62c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1868789733964928:0@lo:400:kworker.0 00000100:00100000:3.0:1782216953.813847:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216953.813900:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733964928 00000100:00100000:0.0:1782216953.813908:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733964928 00000100:00100000:3.0:1782216953.813933:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782216953.813943:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f62df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789733964544:0@lo:400:kworker.0 00000100:00100000:0.0:1782216953.813964:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1782216953.813977:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868789733964928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216953.813982:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216953.814029:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f62e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1868789733965056:0@lo:400:kworker.0 00000100:00100000:0.0:1782216953.814038:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868789733964928:12345-0@lo:400:kworker.0 Request processed in 64us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216953.814047:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1782216953.814061:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782216953.814070:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782216953.814084:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733964544 00000100:00100000:0.0:1782216953.814088:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733964544 00000100:00100000:3.0:1782216953.814100:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f62c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1868789733964928:0@lo:400:kworker.0 00000100:00100000:0.0:1782216953.814112:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1782216953.814121:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+19:3303:x1868789733964544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216953.814156:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+19:3303:x1868789733964544:12345-0@lo:400:kworker.0 Request processed in 37us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216953.814164:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1782216953.814176:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f62df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789733964544:0@lo:400:kworker.0 00000100:00100000:2.0:1782216953.814869:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f62ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789733964672:0@lo:400:kworker.0 00000100:00100000:2.0:1782216953.814935:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216953.814957:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733965056 00000100:00100000:2.0:1782216953.814961:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f62ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733965184:0@lo:400:kworker.0 00000100:00100000:1.0:1782216953.814964:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733965056 00000100:00100000:2.0:1782216953.814992:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216953.815013:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733964672 00000100:00100000:2.0:1782216953.815016:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782216953.815018:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733964672 00000100:00100000:2.0:1782216953.815025:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f62c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733964800:0@lo:400:kworker.0 00000100:00100000:1.0:1782216953.815054:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1782216953.815060:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216953.815067:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1868789733965056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216953.815096:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1782216953.815107:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f75b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789733964672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216953.815118:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1868789733965056:12345-0@lo:400:kworker.0 Request processed in 54us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216953.815126:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1782216953.815151:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782216953.815157:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f75b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789733964672:12345-0@lo:400:kworker.0 Request processed in 51us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216953.815165:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1782216953.815178:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f62e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1868789733965056:0@lo:400:kworker.0 00000100:00100000:2.0:1782216953.815202:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733965184 00000100:00100000:2.0:1782216953.815207:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733965184 00000100:00100000:1.0:1782216953.815212:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733964800 00000100:00100000:1.0:1782216953.815217:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733964800 00000100:00100000:1.0:1782216953.815259:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1782216953.815267:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f759f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733964800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216953.815298:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f759f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733964800:12345-0@lo:400:kworker.0 Request processed in 32us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216953.815305:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1782216953.815348:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782216953.815353:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1782216953.816181:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67f62c380 x1868789733964800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216953.816193:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f62c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733964800:0@lo:400:kworker.0 00000100:00100000:1.0:1782216953.816205:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f62ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789733964672:0@lo:400:kworker.0 00000100:00100000:2.0:1782216953.816528:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1782216953.816537:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f759500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733965184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216953.816585:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f759500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733965184:12345-0@lo:400:kworker.0 Request processed in 50us (1592us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216953.816592:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1782216953.817840:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67f62ea00 x1868789733965184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216953.817853:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f62ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733965184:0@lo:400:kworker.0 00000001:00100000:1.0:1782216953.867666:0:6609:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb 00000020:00000080:1.0:1782216953.867675:0:6609:0:(genops.c:906:class_export_put()) final put ffff88e6755cc800/e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb 00000020:00000080:3.0:1782216953.867806:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff88e6755cc800/e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb for lustre-OST0000 00000020:00000080:3.0:1782216953.867856:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff88e6755cb800 for lustre-OST0000 00000100:00100000:1.0:1782216954.325843:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782216954.325870:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6454aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733965312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782216954.325949:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216954.326010:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733965312 00000100:00100000:1.0:1782216954.326017:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733965312 00000100:00100000:1.0:1782216954.326062:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782216954.326070:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6454aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733965312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782216954.326104:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782216954.326146:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6454aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733965312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216954.326153:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1782216954.326196:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e6454aa300 x1868789733965312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216970 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216954.326214:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6454aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733965312:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782216954.452775:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782216954.625268:0:10867:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1782216955.479247:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216956.500173:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216956.888628:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782216956.888774:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f759180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733965440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782216956.888851:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216956.889657:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733965440 00000100:00100000:1.0:1782216956.889665:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733965440 00000100:00100000:1.0:1782216956.889735:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782216956.889746:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733965440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782216956.889782:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1782216956.889902:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782216956.890383:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67f759180 x1868789733965440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216972 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216956.890405:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f759180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733965440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782216956.890460:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733965440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 457us (1351us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216956.890467:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000001:00100000:1.0:1782216956.941948:0:7488:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb 00000020:00000080:1.0:1782216956.941958:0:7488:0:(genops.c:906:class_export_put()) final put ffff88e6755ce000/e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb 00000020:00000080:0.0:1782216956.942123:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff88e6755ce000/e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb for lustre-OST0001 00000020:00000080:0.0:1782216956.942173:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff88e6755ce800 for lustre-OST0001 00010000:00010000:2.0:1782216957.529107:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216957.952413:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216957.952460:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216957.952496:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216957.952525:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714008576 00000100:00100000:2.0:1782216957.952534:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714008576 00000100:00100000:2.0:1782216957.952584:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714008704 00000100:00100000:2.0:1782216957.952588:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714008704 00000100:00100000:2.0:1782216957.952611:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 84 00000100:00100000:2.0:1782216957.952620:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f758a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2357:x1868789714008576:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:3.0:1782216957.952731:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714008448 00000100:00100000:3.0:1782216957.952735:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714008448 00000100:00100000:3.0:1782216957.952765:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 228 00000100:00100000:3.0:1782216957.952773:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2357:x1868789714008448:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:3.0:1782216957.952838:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2357:x1868789714008448:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 65us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216957.952847:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 228 00000100:00080000:3.0:1782216957.952924:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782216957.953116:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f758a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2357:x1868789714008576:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 496us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216957.953123:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 84 00000100:00100000:2.0:1782216957.953138:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 85 00000100:00100000:2.0:1782216957.953145:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f758380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2357:x1868789714008704:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:2.0:1782216957.953169:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f758380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2357:x1868789714008704:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 25us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216957.953175:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 85 00010000:00010000:3.0:1782216958.548243:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782216958.668967:0:11015:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffee43dd0c0 20000000:00000080:1.0:1782216958.668984:0:11015:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88e67a787800 uarg=0000000000000000 20000000:01000000:1.0:1782216958.669018:0:11015:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1782216958.669031:0:11015:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1782216958.669035:0:11015:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1782216958.680500:0:11016:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1782216958.680686:0:11015:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1782216958.696548:0:11015:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1782216958.701553:0:11015:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88e67437b800/0xf210a9075089ebfe lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216958.701579:0:11015:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88e67fd07c00/0xf210a9075089eba3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6201a9 expref: 12 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216958.701587:0:11015:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88e653161200/0xf210a9075089ebb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089ebaa expref: 18 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216958.701595:0:11015:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88e67437ae00/0xf210a9075089ebbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089ebb8 expref: 18 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216958.701601:0:11015:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88e653160400/0xf210a9075089ebcd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089ebc6 expref: 18 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216958.701608:0:11015:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88e67a2d2a00/0xf210a9075089ebe2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6201e1 expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216958.701616:0:11015:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88e67437b800/0xf210a9075089ebfe lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216958.701672:0:11015:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88e67a2d2a00/0xf210a9075089ebe2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6201e1 expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216958.701687:0:11015:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88e67a2d2a00/0xf210a9075089ebe2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6201e1 expref: 12 pid: 5778 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216958.701701:0:11015:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11015:1868789733965568:192.168.203.19@tcp:104: 00010000:00010000:0.0:1782216958.701874:0:11015:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88e653160400/0xf210a9075089ebcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf210a9075089ebc6 expref: 18 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216958.701908:0:11015:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88e653160400/0xf210a9075089ebcd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf210a9075089ebc6 expref: 18 pid: 5776 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216958.701917:0:11015:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11015:1868789733965696:0@lo:104: 00000100:00100000:0.0:1782216958.701956:0:11015:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782216958.701996:0:11015:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88e67437ae00/0xf210a9075089ebbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf210a9075089ebb8 expref: 18 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216958.702004:0:11015:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88e67437ae00/0xf210a9075089ebbf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf210a9075089ebb8 expref: 18 pid: 5775 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216958.702013:0:11015:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a807480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11015:1868789733965824:0@lo:104: 00000100:00100000:0.0:1782216958.702046:0:11015:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782216958.702076:0:11015:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88e653161200/0xf210a9075089ebb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf210a9075089ebaa expref: 18 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216958.702083:0:11015:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88e653161200/0xf210a9075089ebb1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf210a9075089ebaa expref: 18 pid: 5776 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216958.702101:0:11015:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a806680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11015:1868789733965952:0@lo:104: 00000100:00100000:0.0:1782216958.702123:0:11015:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782216958.702144:0:11015:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88e67fd07c00/0xf210a9075089eba3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6201a9 expref: 12 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216958.702151:0:11015:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88e67fd07c00/0xf210a9075089eba3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6201a9 expref: 12 pid: 5776 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216958.702158:0:11015:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a801180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11015:1868789733966080:192.168.203.19@tcp:104: 00000100:00100000:0.0:1782216958.702194:0:11015:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e65f437780 going to sleep for 11 seconds 00000100:00100000:3.0:1782216958.703866:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733965696 00000100:00100000:3.0:1782216958.703896:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733965696 00000100:00100000:3.0:1782216958.703942:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733965824 00000100:00100000:3.0:1782216958.703945:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733965824 00000100:00100000:3.0:1782216958.703957:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733965952 00000100:00100000:3.0:1782216958.703959:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733965952 00000100:00100000:3.0:1782216958.703974:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782216958.703983:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a804000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:526a4802-b871-4bcf-870f-067f11655366+5:11015:x1868789733965696:12345-0@lo:104: 00010000:00010000:3.0:1782216958.704010:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.119@tcp lock: ffff88e653161600/0xf210a9075089ebc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089ebcd expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216958.704097:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782216958.704103:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a804000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:526a4802-b871-4bcf-870f-067f11655366+5:11015:x1868789733965696:12345-0@lo:104: Request processed in 121us (2147us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216958.704110:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782216958.704127:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782216958.704132:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a806a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:526a4802-b871-4bcf-870f-067f11655366+4:11015:x1868789733965824:12345-0@lo:104: 00010000:00010000:3.0:1782216958.704140:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.119@tcp lock: ffff88e653161c00/0xf210a9075089ebb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089ebbf expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216958.704171:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782216958.704175:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a806a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:526a4802-b871-4bcf-870f-067f11655366+4:11015:x1868789733965824:12345-0@lo:104: Request processed in 43us (2129us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216958.704181:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782216958.704192:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782216958.704197:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a804e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:526a4802-b871-4bcf-870f-067f11655366+3:11015:x1868789733965952:12345-0@lo:104: 00010000:00010000:3.0:1782216958.704205:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2600/0xf210a9075089ebaa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089ebb1 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216958.704360:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1782216958.704366:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a804e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:526a4802-b871-4bcf-870f-067f11655366+3:11015:x1868789733965952:12345-0@lo:104: Request processed in 169us (2243us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216958.704383:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1782216958.704401:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1782216958.704407:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e653161600/0xf210a9075089ebc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089ebcd expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216958.704420:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e653161600 already unused, calling callback (ffffffffc1d2fc20) 10000000:00010000:3.0:1782216958.704425:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e653161600/0xf210a9075089ebc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf210a9075089ebcd expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216958.704433:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e653161600/0xf210a9075089ebc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf210a9075089ebcd expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782216958.704440:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e653161600/0xf210a9075089ebc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf210a9075089ebcd expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782216958.704446:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782216958.704476:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: ffff88e653161600/0xf210a9075089ebc6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089ebcd expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216958.704483:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782216958.704504:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e653161600/0xf210a9075089ebc6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089ebcd expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216958.704512:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e653161600/0xf210a9075089ebc6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089ebcd expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216958.704524:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782216958.704527:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e653161c00/0xf210a9075089ebb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089ebbf expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216958.704533:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e653161c00 already unused, calling callback (ffffffffc1d2fc20) 10000000:00010000:3.0:1782216958.704536:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e653161c00/0xf210a9075089ebb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf210a9075089ebbf expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216958.704553:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e653161c00/0xf210a9075089ebb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf210a9075089ebbf expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782216958.704559:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e653161c00/0xf210a9075089ebb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf210a9075089ebbf expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782216958.704564:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782216958.704577:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: ffff88e653161c00/0xf210a9075089ebb8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089ebbf expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216958.704582:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782216958.704597:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e653161c00/0xf210a9075089ebb8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089ebbf expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216958.704605:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e653161c00/0xf210a9075089ebb8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089ebbf expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216958.704614:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782216958.704617:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2600/0xf210a9075089ebaa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089ebb1 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216958.704622:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67a2d2600 already unused, calling callback (ffffffffc1d2fc20) 10000000:00010000:3.0:1782216958.704625:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2600/0xf210a9075089ebaa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf210a9075089ebb1 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216958.704632:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2600/0xf210a9075089ebaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf210a9075089ebb1 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782216958.704638:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2600/0xf210a9075089ebaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf210a9075089ebb1 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782216958.704648:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782216958.704660:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2600/0xf210a9075089ebaa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089ebb1 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216958.704666:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782216958.704672:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2600/0xf210a9075089ebaa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089ebb1 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216958.704678:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e67a2d2600/0xf210a9075089ebaa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089ebb1 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216958.704689:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216958.704691:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216958.704693:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216958.704699:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216958.704728:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733966208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782216958.704762:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216958.704806:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:526a4802-b871-4bcf-870f-067f11655366:3301:1868789733966336:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782216958.704830:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216958.704845:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782216958.704849:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:526a4802-b871-4bcf-870f-067f11655366:3301:1868789733966464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782216958.704866:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216958.704908:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733966208 00000100:00100000:3.0:1782216958.704913:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733966208 00010000:00010000:3.0:1782216958.704931:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88e653160400/0xf210a9075089ebcd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089ebc6 expref: 19 pid: 5776 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216958.704949:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733966336 00000100:00100000:3.0:1782216958.704957:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733966336 00010000:00010000:3.0:1782216958.704969:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88e67437ae00/0xf210a9075089ebbf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089ebb8 expref: 20 pid: 5775 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216958.704985:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733966464 00000100:00100000:3.0:1782216958.704988:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733966464 00010000:00010000:3.0:1782216958.704998:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88e653161200/0xf210a9075089ebb1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089ebaa expref: 21 pid: 5776 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216958.705015:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782216958.705863:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782216958.705891:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64479b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:526a4802-b871-4bcf-870f-067f11655366+21:3301:x1868789733966336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782216958.705905:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782216958.705912:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88e67437ae00/0xf210a9075089ebbf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089ebb8 expref: 21 pid: 5775 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216958.705922:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88e67437ae00/0xf210a9075089ebbf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf210a9075089ebb8 expref: 21 pid: 5775 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216958.705940:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782216958.705984:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64479b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:526a4802-b871-4bcf-870f-067f11655366+21:3301:x1868789733966336:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (1152us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216958.705991:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782216958.706008:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782216958.706014:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:526a4802-b871-4bcf-870f-067f11655366+20:3301:x1868789733966464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782216958.706033:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782216958.706038:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88e653161200/0xf210a9075089ebb1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089ebaa expref: 20 pid: 5776 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216958.706046:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88e653161200/0xf210a9075089ebb1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf210a9075089ebaa expref: 20 pid: 5776 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216958.706055:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782216958.706075:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:526a4802-b871-4bcf-870f-067f11655366+20:3301:x1868789733966464:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (1208us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216958.706093:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782216958.706151:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:526a4802-b871-4bcf-870f-067f11655366:3301:1868789733966464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782216958.706160:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:526a4802-b871-4bcf-870f-067f11655366:3301:1868789733966336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782216958.706499:0:11015:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11015:1868789733965696:0@lo:104: 00010000:00010000:0.0:1782216958.706510:0:11015:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e67437ae00/0xf210a9075089ebbf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf210a9075089ebb8 expref: 19 pid: 5775 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216958.706522:0:11015:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a807480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11015:1868789733965824:0@lo:104: 00010000:00010000:0.0:1782216958.706530:0:11015:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e653161200/0xf210a9075089ebb1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf210a9075089ebaa expref: 18 pid: 5776 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216958.706539:0:11015:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a806680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11015:1868789733965952:0@lo:104: 00000100:00100000:3.0:1782216958.707498:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:526a4802-b871-4bcf-870f-067f11655366+17:3304:x1868789733966208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782216958.707521:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782216958.707529:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88e653160400/0xf210a9075089ebcd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089ebc6 expref: 17 pid: 5776 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216958.707539:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88e653160400/0xf210a9075089ebcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf210a9075089ebc6 expref: 17 pid: 5776 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216958.707552:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e653160400/0xf210a9075089ebcd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf210a9075089ebc6 expref: 17 pid: 5776 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216958.707565:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782216958.707631:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:526a4802-b871-4bcf-870f-067f11655366+16:3304:x1868789733966208:12345-0@lo:103:ldlm_bl.0 Request processed in 2609us (2867us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216958.707640:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782216958.708040:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733966208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782216958.714084:0:11015:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11015:1868789733965568:192.168.203.19@tcp:104: 00000100:00100000:0.0:1782216958.714097:0:11015:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a801180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11015:1868789733966080:192.168.203.19@tcp:104: 00010000:00010000:0.0:1782216958.714131:0:11015:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88e67437b800/0xf210a9075089ebfe lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216958.716301:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216958.716353:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216958.716553:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714008960 00000100:00100000:1.0:1782216958.716561:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714008960 00010000:00010000:1.0:1782216958.716608:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88e67fd07c00/0xf210a9075089eba3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6201a9 expref: 13 pid: 5776 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216958.716644:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714008832 00000100:00100000:1.0:1782216958.716647:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714008832 00010000:00010000:1.0:1782216958.716660:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88e67a2d2a00/0xf210a9075089ebe2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6201e1 expref: 14 pid: 5778 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216958.716682:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 28 00000100:00100000:1.0:1782216958.716689:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f759180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+14:2358:x1868789714008960:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782216958.716710:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782216958.716724:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88e67fd07c00/0xf210a9075089eba3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6201a9 expref: 14 pid: 5776 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216958.716734:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88e67fd07c00/0xf210a9075089eba3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6201a9 expref: 14 pid: 5776 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216958.716752:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e67fd07c00/0xf210a9075089eba3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6201a9 expref: 14 pid: 5776 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216958.716766:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782216958.716810:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f759180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2358:x1868789714008960:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 121us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216958.716824:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 28 00000100:00100000:1.0:1782216958.716842:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 29 00000100:00100000:1.0:1782216958.716847:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652501180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+12:2358:x1868789714008832:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782216958.716855:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782216958.716859:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88e67a2d2a00/0xf210a9075089ebe2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6201e1 expref: 12 pid: 5778 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216958.716868:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88e67a2d2a00/0xf210a9075089ebe2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6201e1 expref: 12 pid: 5778 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216958.716909:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e67a2d2a00/0xf210a9075089ebe2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6201e1 expref: 12 pid: 5778 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216958.716920:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88e67437b800/0xf210a9075089ebfe lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216958.716929:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e67437b800/0xf210a9075089ebfe lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216958.716943:0:5769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88e67437b800/0xf210a9075089ebfe lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216958.716950:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88e67437b800/0xf210a9075089ebfe lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216958.716956:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88e67437b800/0xf210a9075089ebfe lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216958.716963:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88e67437b800/0xf210a9075089ebfe lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216958.716975:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437b800 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:1.0:1782216958.716979:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88e67437b800/0xf210a9075089ebfe lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216958.716987:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88e67437b800/0xf210a9075089ebfe lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216958.716999:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88e67437b800/0xf210a9075089ebfe lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216958.717008:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782216958.717033:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652501180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+11:2358:x1868789714008832:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 185us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216958.717039:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 29 00010000:00010000:0.0:1782216958.718620:0:11015:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88e67437b800/0xf210a9075089ebfe lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216958.718636:0:11015:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88e67437b800/0xf210a9075089ebfe lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216958.718642:0:11015:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e67437b800/0xf210a9075089ebfe lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216958.947195:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a802680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733966720:0@lo:400:kworker.0 00000100:00100000:0.0:1782216958.947259:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216958.947308:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1782216958.947314:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a801180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868789733966592:0@lo:400:kworker.0 00000100:00100000:0.0:1782216958.947337:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216958.947354:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a803480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733967104:0@lo:400:kworker.0 00000100:00100000:0.0:1782216958.947371:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216958.947412:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1868789733966848:0@lo:400:kworker.0 00000100:00100000:0.0:1782216958.947435:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216958.947451:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782216958.947456:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a800700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1868789733966976:0@lo:400:kworker.0 00000100:00100000:0.0:1782216958.947475:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216958.947499:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733966720 00000100:00100000:0.0:1782216958.947506:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733966720 00000100:00100000:0.0:1782216958.947551:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733967104 00000100:00100000:0.0:1782216958.947554:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733967104 00000100:00100000:0.0:1782216958.947575:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1782216958.947583:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733966720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216958.947646:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733966720:12345-0@lo:400:kworker.0 Request processed in 63us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216958.947653:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1782216958.947669:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1782216958.947675:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733967104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216958.947701:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733967104:12345-0@lo:400:kworker.0 Request processed in 27us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216958.947707:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1782216958.947736:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733966592 00000100:00100000:0.0:1782216958.947740:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733966592 00000100:00100000:0.0:1782216958.947762:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733966848 00000100:00100000:0.0:1782216958.947765:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733966848 00000100:00100000:0.0:1782216958.947777:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733966976 00000100:00100000:0.0:1782216958.947779:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733966976 00000100:00100000:0.0:1782216958.947791:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1782216958.947797:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a803800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868789733966592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216958.947826:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a803800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868789733966592:12345-0@lo:400:kworker.0 Request processed in 29us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216958.947832:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1782216958.947843:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1782216958.947849:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a801500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1868789733966848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216958.947897:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a801500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1868789733966848:12345-0@lo:400:kworker.0 Request processed in 29us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216958.947904:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1782216958.947914:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1782216958.947920:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1868789733966976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216958.947954:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1868789733966976:12345-0@lo:400:kworker.0 Request processed in 34us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216958.947960:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1782216958.948010:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a801180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868789733966592:0@lo:400:kworker.0 00010000:00080000:0.0:1782216958.948023:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67a803480 x1868789733967104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216958.948033:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a803480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733967104:0@lo:400:kworker.0 00010000:00080000:0.0:1782216958.948043:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67a802680 x1868789733966720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216958.948052:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a802680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733966720:0@lo:400:kworker.0 00000100:00100000:0.0:1782216958.948083:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a800700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1868789733966976:0@lo:400:kworker.0 00000100:00100000:0.0:1782216958.948092:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1868789733966848:0@lo:400:kworker.0 00000100:00080000:3.0:1782216958.948340:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782216958.948345:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782216958.948347:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782216959.444920:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6454aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733967232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782216959.445011:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216959.445248:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733967232 00000100:00100000:2.0:1782216959.445266:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733967232 00000100:00100000:2.0:1782216959.445316:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782216959.445325:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733967232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782216959.445371:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782216959.445663:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733967232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 339us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216959.445671:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1782216959.445802:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e6454aa300 x1868789733967232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216975 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216959.445820:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6454aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733967232:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782216959.573197:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782216959.763997:0:5780:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782216959.764008:0:5780:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff88e64853e800 from 7 10000000:01000000:3.0:1782216959.764036:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782216959.764101:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e640031600/0xf210a9075089ec05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216959.764117:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e640031600/0xf210a9075089ec05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216959.764132:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e640031600/0xf210a9075089ec05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216959.764165:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733967360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782216959.764261:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216959.764383:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6447df6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782216959.769868:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733967360 00000100:00100000:2.0:1782216959.769906:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733967360 00000100:00100000:2.0:1782216959.769994:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1782216959.770005:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+16:5780:x1868789733967360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782216959.770028:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216959.770064:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e67a2d3000/0xf210a9075089ec0c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089ec05 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216959.770101:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e67a2d3000/0xf210a9075089ec0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089ec05 expref: 17 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216959.770113:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e67a2d3000/0xf210a9075089ec0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089ec05 expref: 17 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216959.770127:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67a2d3000, rc 0) 00000100:00100000:2.0:1782216959.770228:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+17:5780:x1868789733967360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 225us (5967us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216959.770236:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1782216959.770381:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733967360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782216959.770403:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e640031600/0xf210a9075089ec05 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ec0c expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216959.770414:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e640031600/0xf210a9075089ec05 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089ec0c expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216959.770526:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a803b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733967488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782216959.770568:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216959.770613:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e65f437480 going to sleep for 11 seconds 00000100:00100000:2.0:1782216959.770948:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733967488 00000100:00100000:2.0:1782216959.770955:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733967488 00000100:00100000:2.0:1782216959.770983:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1782216959.770990:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+17:5780:x1868789733967488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782216959.771304:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+17:5780:x1868789733967488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 313us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216959.771312:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1782216959.771407:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a803b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733967488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782216959.771458:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a803b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733967616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782216959.771518:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216959.771550:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e65f437480 going to sleep for 11 seconds 00000100:00100000:3.0:1782216959.771736:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733967616 00000100:00100000:3.0:1782216959.771742:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733967616 00000100:00100000:3.0:1782216959.771779:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1782216959.771787:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+17:5780:x1868789733967616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782216959.771981:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+17:5780:x1868789733967616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 195us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216959.771989:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1782216959.772178:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a803b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733967616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1782216959.773535:0:11036:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1782216959.773821:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1782216959.773848:0:5780:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782216959.773861:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e640031600/0xf210a9075089ec05 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ec0c expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216959.773874:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e640031600/0xf210a9075089ec05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ec0c expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216959.773909:0:5780:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782216959.773912:0:5780:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff88e673f4d000 from 7 10000000:01000000:0.0:1782216959.773915:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782216959.773954:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67437ae00/0xf210a9075089ec13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216959.773962:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e67437ae00/0xf210a9075089ec13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216959.773971:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e67437ae00/0xf210a9075089ec13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216959.773999:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a803b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733967744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782216959.774069:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216959.774111:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e65f437480 going to sleep for 11 seconds 00000100:00100000:3.0:1782216959.774231:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733967744 00000100:00100000:3.0:1782216959.774239:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733967744 00000100:00100000:3.0:1782216959.774288:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1782216959.774299:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+17:5780:x1868789733967744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782216959.774312:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782216959.774325:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e640031200/0xf210a9075089ec1a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089ec13 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216959.774362:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e640031200/0xf210a9075089ec1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089ec13 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216959.774382:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e640031200/0xf210a9075089ec1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089ec13 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216959.774392:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e640031200, rc 0) 00000100:00100000:3.0:1782216959.774438:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+18:5780:x1868789733967744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216959.774446:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1782216959.774961:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a803b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733967744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782216959.774980:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e67437ae00/0xf210a9075089ec13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ec1a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216959.774989:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e67437ae00/0xf210a9075089ec13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089ec1a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216959.775047:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652502680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733967872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782216959.775259:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216959.775295:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e644710540 going to sleep for 11 seconds 00000100:00100000:3.0:1782216959.775340:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733967872 00000100:00100000:3.0:1782216959.775356:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733967872 00000100:00100000:3.0:1782216959.775396:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1782216959.775404:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+18:5780:x1868789733967872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782216959.775966:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+18:5780:x1868789733967872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 560us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216959.775975:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1782216959.776070:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652502680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733967872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782216959.776108:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a800700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733968000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782216959.776153:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216959.776182:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e65f437780 going to sleep for 11 seconds 00000100:00100000:3.0:1782216959.776281:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733968000 00000100:00100000:3.0:1782216959.776286:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733968000 00000100:00100000:3.0:1782216959.776319:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1782216959.776328:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+18:5780:x1868789733968000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782216959.776873:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+18:5780:x1868789733968000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 544us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216959.776905:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1782216959.780450:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a800700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733968000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1782216959.781490:0:11037:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1782216959.781665:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1782216959.781686:0:5780:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782216959.781699:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67437ae00/0xf210a9075089ec13 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ec1a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216959.781723:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e67437ae00/0xf210a9075089ec13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ec1a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216959.781736:0:5780:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782216959.781740:0:5780:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff88e650a2a800 from 7 10000000:01000000:0.0:1782216959.781743:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782216959.781791:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67437a800/0xf210a9075089ec21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216959.781800:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e67437a800/0xf210a9075089ec21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216959.781812:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e67437a800/0xf210a9075089ec21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216959.781847:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a800700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733968128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782216959.781957:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216959.782000:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e65f437780 going to sleep for 11 seconds 00000100:00100000:2.0:1782216959.782078:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733968128 00000100:00100000:2.0:1782216959.782085:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733968128 00000100:00100000:2.0:1782216959.782126:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1782216959.782135:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+18:5780:x1868789733968128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782216959.782152:0:5775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216959.782166:0:5775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e67a2d2200/0xf210a9075089ec28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089ec21 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216959.782191:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e67a2d2200/0xf210a9075089ec28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089ec21 expref: 19 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216959.782203:0:5775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e67a2d2200/0xf210a9075089ec28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089ec21 expref: 19 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216959.782219:0:5775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67a2d2200, rc 0) 00000100:00100000:2.0:1782216959.782261:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+19:5780:x1868789733968128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216959.782270:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1782216959.782314:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a800700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733968128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782216959.782329:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e67437a800/0xf210a9075089ec21 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ec28 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216959.782338:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e67437a800/0xf210a9075089ec21 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089ec28 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216959.782386:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652502300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733968256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782216959.782411:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216959.782426:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e644710600 going to sleep for 11 seconds 00000100:00100000:3.0:1782216959.782496:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733968256 00000100:00100000:3.0:1782216959.782501:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733968256 00000100:00100000:3.0:1782216959.782534:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1782216959.782541:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+19:5780:x1868789733968256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782216959.782824:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+19:5780:x1868789733968256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 282us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216959.782838:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1782216959.782938:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652502300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733968256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782216959.782968:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652502300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733968384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782216959.783007:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216959.783023:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e644710600 going to sleep for 11 seconds 00000100:00100000:0.0:1782216959.783144:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733968384 00000100:00100000:0.0:1782216959.783148:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733968384 00000100:00100000:0.0:1782216959.783180:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1782216959.783187:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+19:5780:x1868789733968384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782216959.783343:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+19:5780:x1868789733968384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216959.783350:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1782216959.783457:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652502300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733968384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1782216959.784576:0:11038:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1782216959.786989:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1782216959.787030:0:5780:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782216959.787045:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67437a800/0xf210a9075089ec21 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ec28 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216959.787072:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e67437a800/0xf210a9075089ec21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ec28 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216960.380248:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216960.380394:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714009088 00000100:00100000:1.0:1782216960.380416:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714009088 00000100:00100000:1.0:1782216960.380472:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 238 00000100:00100000:1.0:1782216960.380484:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+11:5572:x1868789714009088:12345-192.168.203.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782216960.380505:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782216960.380527:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e67fd07000/0xf210a9075089ec2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62020b expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216960.380561:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e67fd07000/0xf210a9075089ec2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62020b expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216960.380573:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e67fd07000/0xf210a9075089ec2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62020b expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216960.380597:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd07000, rc 0) 00000100:00100000:1.0:1782216960.380671:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+12:5572:x1868789714009088:12345-192.168.203.19@tcp:101:ll_cfg_requeue.0 Request processed in 189us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216960.380679:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 238 00000100:00100000:0.0:1782216960.385047:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216960.386518:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714009216 00000100:00100000:3.0:1782216960.386536:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714009216 00000100:00100000:3.0:1782216960.386617:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 239 00000100:00100000:3.0:1782216960.386630:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+12:5572:x1868789714009216:12345-192.168.203.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782216960.387078:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+12:5572:x1868789714009216:12345-192.168.203.19@tcp:501:ll_cfg_requeue.0 Request processed in 449us (2045us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216960.387088:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 239 00000100:00100000:2.0:1782216960.392976:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782216960.393090:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714009344 00000100:00100000:0.0:1782216960.393102:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714009344 00000100:00100000:0.0:1782216960.393167:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 240 00000100:00100000:0.0:1782216960.393179:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+12:5572:x1868789714009344:12345-192.168.203.19@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782216960.393477:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+12:5572:x1868789714009344:12345-192.168.203.19@tcp:503:ll_cfg_requeue.0 Request processed in 300us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216960.393486:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 240 00000100:00100000:1.0:1782216960.410658:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216960.411571:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714009472 00000100:00100000:2.0:1782216960.411586:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714009472 00000100:00100000:2.0:1782216960.411653:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 241 00000100:00100000:2.0:1782216960.411666:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+12:5572:x1868789714009472:12345-192.168.203.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782216960.411698:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216960.411728:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e67a2d2600/0xf210a9075089ec36 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620212 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216960.411761:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e67a2d2600/0xf210a9075089ec36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620212 expref: 13 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216960.411980:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e67a2d2600/0xf210a9075089ec36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620212 expref: 13 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216960.411990:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67a2d2600, rc 0) 00000100:00100000:2.0:1782216960.412070:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:5572:x1868789714009472:12345-192.168.203.19@tcp:101:ll_cfg_requeue.0 Request processed in 406us (1427us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216960.412078:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 241 00000100:00100000:2.0:1782216960.419395:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216960.419586:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714009600 00000100:00100000:1.0:1782216960.419600:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714009600 00000100:00100000:1.0:1782216960.419663:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 242 00000100:00100000:1.0:1782216960.419683:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:5572:x1868789714009600:12345-192.168.203.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782216960.420325:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:5572:x1868789714009600:12345-192.168.203.19@tcp:501:ll_cfg_requeue.0 Request processed in 527us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216960.420336:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 242 00000100:00100000:1.0:1782216960.429244:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216960.429294:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714009728 00000100:00100000:1.0:1782216960.429306:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714009728 00000100:00100000:1.0:1782216960.429360:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 243 00000100:00100000:1.0:1782216960.429371:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:5572:x1868789714009728:12345-192.168.203.19@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782216960.429659:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:5572:x1868789714009728:12345-192.168.203.19@tcp:503:ll_cfg_requeue.0 Request processed in 288us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216960.429667:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 243 00010000:00010000:3.0:1782216960.600507:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216961.629831:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216962.007997:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652502300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733968512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782216962.008065:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216962.008140:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733968512 00000100:00100000:2.0:1782216962.008148:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733968512 00000100:00100000:2.0:1782216962.008196:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782216962.008206:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733968512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782216962.008240:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782216962.008285:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733968512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216962.008292:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1782216962.008312:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782216962.008339:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e652502300 x1868789733968512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216978 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216962.008356:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652502300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733968512:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782216962.646143:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782216963.070867:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216963.070935:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216963.070964:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714010112 00000100:00100000:1.0:1782216963.070972:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714010112 00000100:00100000:1.0:1782216963.071049:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 89 00000100:00100000:1.0:1782216963.071057:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6454a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2359:x1868789714010112:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:1.0:1782216963.071126:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6454a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2359:x1868789714010112:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 69us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216963.071134:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 89 00000100:00080000:1.0:1782216963.071157:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782216963.071572:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714009856 00000100:00100000:3.0:1782216963.071578:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714009856 00000100:00100000:3.0:1782216963.071621:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 244 00000100:00100000:3.0:1782216963.071629:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2359:x1868789714009856:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:3.0:1782216963.071664:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2359:x1868789714009856:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 36us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216963.071670:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 244 00000100:00100000:1.0:1782216963.073000:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782216963.073277:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714009984 00000100:00100000:0.0:1782216963.073285:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714009984 00000100:00100000:0.0:1782216963.073350:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 90 00000100:00100000:0.0:1782216963.073360:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6454a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2359:x1868789714009984:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:0.0:1782216963.073424:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6454a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2359:x1868789714009984:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 66us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216963.073446:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 90 00000100:00080000:1.0:1782216963.073803:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782216963.669784:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216964.054321:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6454a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:526a4802-b871-4bcf-870f-067f11655366:3302:1868789733968640:0@lo:400:kworker.0 00000100:00100000:0.0:1782216964.054390:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216964.054431:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6454aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1868789733969152:0@lo:400:kworker.0 00000100:00100000:0.0:1782216964.054459:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216964.054484:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782216964.054490:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6454a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1868789733969024:0@lo:400:kworker.0 00000100:00100000:0.0:1782216964.054511:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216964.054536:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6454a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733968896:0@lo:400:kworker.0 00000100:00100000:0.0:1782216964.054562:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216964.054579:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1782216964.054584:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6454aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868789733968768:0@lo:400:kworker.0 00000100:00100000:0.0:1782216964.054602:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216964.054615:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6454a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733969280:0@lo:400:kworker.0 00000100:00100000:0.0:1782216964.054646:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216964.054712:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733969152 00000100:00100000:0.0:1782216964.054720:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733969152 00000100:00100000:0.0:1782216964.054768:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733969024 00000100:00100000:0.0:1782216964.054772:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733969024 00000100:00100000:0.0:1782216964.054786:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733968768 00000100:00100000:0.0:1782216964.054789:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733968768 00000100:00100000:0.0:1782216964.054803:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1782216964.054810:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a802680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1868789733969152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216964.054859:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a802680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1868789733969152:12345-0@lo:400:kworker.0 Request processed in 49us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216964.054866:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1782216964.054918:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1782216964.054925:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a803480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1868789733969024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216964.054956:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a803480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1868789733969024:12345-0@lo:400:kworker.0 Request processed in 32us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216964.054962:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1782216964.054973:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1782216964.054979:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868789733968768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216964.055008:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868789733968768:12345-0@lo:400:kworker.0 Request processed in 29us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216964.055014:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1782216964.055032:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733968896 00000100:00100000:0.0:1782216964.055035:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733968896 00000100:00100000:0.0:1782216964.055056:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733969280 00000100:00100000:0.0:1782216964.055058:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733969280 00000100:00100000:0.0:1782216964.055073:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782216964.055078:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733968896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216964.055107:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733968896:12345-0@lo:400:kworker.0 Request processed in 28us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216964.055112:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782216964.055123:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782216964.055128:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733969280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216964.055154:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733969280:12345-0@lo:400:kworker.0 Request processed in 26us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216964.055160:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1782216964.055346:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733968640 00000100:00100000:1.0:1782216964.055351:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733968640 00000100:00100000:1.0:1782216964.055376:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1782216964.055381:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+19:3302:x1868789733968640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216964.055419:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+19:3302:x1868789733968640:12345-0@lo:400:kworker.0 Request processed in 37us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216964.055425:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:1.0:1782216964.055451:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782216964.055454:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782216964.055457:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782216964.061569:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6454aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868789733968768:0@lo:400:kworker.0 00010000:00080000:1.0:1782216964.062841:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e6454a8a80 x1868789733969280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216964.062856:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6454a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733969280:0@lo:400:kworker.0 00010000:00080000:1.0:1782216964.062901:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e6454a8380 x1868789733968896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216964.062910:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6454a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733968896:0@lo:400:kworker.0 00000100:00100000:1.0:1782216964.062968:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6454a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1868789733969024:0@lo:400:kworker.0 00000100:00100000:1.0:1782216964.062979:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6454a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:526a4802-b871-4bcf-870f-067f11655366:3302:1868789733968640:0@lo:400:kworker.0 00000100:00100000:1.0:1782216964.062989:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6454aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1868789733969152:0@lo:400:kworker.0 00000001:02000400:1.0:1782216964.384377:0:11214:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg319-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1782216964.571308:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6454aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733969408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782216964.571378:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216964.571473:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733969408 00000100:00100000:1.0:1782216964.571481:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733969408 00000100:00100000:0.0:1782216964.572759:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1782216964.572770:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648469c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733969408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782216964.572805:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782216964.572862:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648469c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733969408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (1483us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216964.572869:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1782216964.572926:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e6454aad80 x1868789733969408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216980 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216964.572943:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6454aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733969408:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782216964.698458:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216965.716084:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216966.741258:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216967.124074:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652502300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733969536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782216967.124141:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216967.124241:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733969536 00000100:00100000:1.0:1782216967.124249:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733969536 00000100:00100000:1.0:1782216967.124304:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1782216967.124312:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648468000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733969536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782216967.124345:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1782216967.124426:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782216967.127501:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648468000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733969536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3180us (3349us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216967.127517:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1782216967.129496:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e652502300 x1868789733969536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216983 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216967.129536:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652502300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733969536:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782216967.765609:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782216968.214433:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216968.214489:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216968.214512:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216968.214547:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714010368 00000100:00100000:1.0:1782216968.214555:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714010368 00000100:00100000:1.0:1782216968.214612:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714010496 00000100:00100000:1.0:1782216968.214616:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714010496 00000100:00100000:1.0:1782216968.214661:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 94 00000100:00100000:1.0:1782216968.214671:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6454a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2359:x1868789714010368:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:1.0:1782216968.214736:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6454a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2359:x1868789714010368:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 66us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216968.214754:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 94 00000100:00100000:1.0:1782216968.214771:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 95 00000100:00100000:1.0:1782216968.214777:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6454a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2359:x1868789714010496:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:1.0:1782216968.214801:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6454a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2359:x1868789714010496:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 24us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216968.214806:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 95 00000100:00100000:1.0:1782216968.214824:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714010240 00000100:00100000:1.0:1782216968.214827:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714010240 00000100:00100000:1.0:1782216968.214849:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 246 00000100:00100000:1.0:1782216968.214854:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2359:x1868789714010240:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:1.0:1782216968.214911:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2359:x1868789714010240:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 55us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216968.214917:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 246 00000100:00080000:3.0:1782216968.216762:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1782216968.471169:0:11314:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 08:16:06 (1782216966) === 00000100:00100000:0.0:1782216968.735089:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782216968.735176:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216968.735390:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714010624 00000100:00100000:2.0:1782216968.735399:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714010624 00000100:00100000:2.0:1782216968.735453:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 14 00000100:00100000:2.0:1782216968.735463:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2357:x1868789714010624:12345-192.168.203.19@tcp:41:mkdir.0 00000004:00000024:2.0:1782216968.735502:0:5785:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1782216968.735601:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2357:x1868789714010624:12345-192.168.203.19@tcp:41:mkdir.0 Request processed in 138us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216968.735608:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 14 00000100:00100000:0.0:1782216968.736022:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714010752 00000100:00100000:0.0:1782216968.736028:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714010752 00000100:00100000:0.0:1782216968.736065:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 0 00000100:00100000:0.0:1782216968.736073:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64846aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:9679:x1868789714010752:12345-192.168.203.19@tcp:700:mkdir.0 00000100:00100000:0.0:1782216968.736124:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64846aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:9679:x1868789714010752:12345-192.168.203.19@tcp:700:mkdir.0 Request processed in 52us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216968.736130:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 0 00000100:00100000:0.0:1782216968.749111:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216968.749215:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714011008 00000100:00100000:1.0:1782216968.749225:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714011008 00000100:00100000:1.0:1782216968.749277:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 15 00000100:00100000:1.0:1782216968.749287:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:9679:x1868789714011008:12345-192.168.203.19@tcp:36:mkdir.0 00010000:00010000:1.0:1782216968.749338:0:6855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782216968.749399:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089eb1e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620194 expref: 6 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216968.749418:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e647d05a00) 00010000:00010000:1.0:1782216968.749429:0:6855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782216968.749753:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089ec3d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216968.749777:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089ec3d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216968.749787:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089ec3d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216968.749814:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089ec44 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216968.749823:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089ec44 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216968.749830:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089ec44 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782216968.751051:0:6855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:1.0:1782216968.751068:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089ec3d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216968.751078:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089ec3d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216968.751085:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089ec3d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216968.751092:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782216968.751097:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089ec3d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216968.751105:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089ec3d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216968.751128:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e67a811000) 00010000:00010000:1.0:1782216968.751131:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782216968.751136:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089ec3d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216968.751143:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089ec3d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782216968.751159:0:6855:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008f52e48a reply state 00000000f0aef145 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089ec44 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216968.751169:0:6855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782216968.751266:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:9679:x1868789714011008:12345-192.168.203.19@tcp:36:mkdir.0 Request processed in 1977us (2159us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1782216968.751274:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 15 00010000:00010000:0.0:1782216968.756118:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089ec44 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216968.756155:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089ec44 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216968.756164:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089ec44 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216968.756171:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782216968.756176:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089ec44 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216968.756184:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089ec44 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216968.756201:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff88e67a811400) 00010000:00010000:0.0:1782216968.756204:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782216968.756209:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089ec44 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216968.756216:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089ec44 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.788825:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216968.796326:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216968.796381:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714011136 00000100:00100000:2.0:1782216968.796391:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714011136 00000100:00100000:2.0:1782216968.796440:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 16 00000100:00100000:2.0:1782216968.796451:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:9680:x1868789714011136:12345-192.168.203.19@tcp:101:chmod.0 00010000:00010000:2.0:1782216968.796479:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216968.796502:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d3a00/0xf210a9075089ec4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620219 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216968.796562:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d2400/0xf210a9075089ec52 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216968.796575:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d2400/0xf210a9075089ec52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216968.796587:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d2400/0xf210a9075089ec52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782216968.796653:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1782216968.796657:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1782216968.796694:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d2400/0xf210a9075089ec52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216968.796719:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d3a00/0xf210a9075089ec4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620219 expref: 8 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216968.796734:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d2400/0xf210a9075089ec52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620219 expref: 7 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216968.796744:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e65417f500) 00010000:00010000:2.0:1782216968.796747:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782216968.796750:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67a2d2400, rc 0) 00000100:00100000:2.0:1782216968.796805:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:9680:x1868789714011136:12345-192.168.203.19@tcp:101:chmod.0 Request processed in 356us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216968.796813:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 16 00000100:00100000:3.0:1782216968.815868:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216968.815927:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714011392 00000100:00100000:3.0:1782216968.815936:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714011392 00000100:00100000:3.0:1782216968.815999:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 17 00000100:00100000:3.0:1782216968.816009:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:9680:x1868789714011392:12345-192.168.203.19@tcp:36:chmod.0 00010000:00010000:3.0:1782216968.816062:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782216968.816088:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d2400/0xf210a9075089ec52 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620219 expref: 7 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.816108:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e65417f500) 00010000:00010000:3.0:1782216968.816119:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782216968.817202:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030a00/0xf210a9075089ec59 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.817221:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030a00/0xf210a9075089ec59 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.817233:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030a00/0xf210a9075089ec59 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782216968.817523:0:5784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000049710d5e reply state 00000000699c89a1 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030a00/0xf210a9075089ec59 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216968.817534:0:5784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1782216968.817547:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1782216968.818786:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+8:9680:x1868789714011392:12345-192.168.203.19@tcp:36:chmod.0 Request processed in 2771us (2919us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1782216968.818798:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 17 00010000:00010000:3.0:1782216968.839353:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030a00/0xf210a9075089ec59 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.839369:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030a00/0xf210a9075089ec59 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.839391:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030a00/0xf210a9075089ec59 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.839398:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640030a00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782216968.839403:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030a00/0xf210a9075089ec59 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.839411:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030a00/0xf210a9075089ec59 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.839426:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e650a64000) 00010000:00010000:3.0:1782216968.839429:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782216968.839433:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030a00/0xf210a9075089ec59 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.839439:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030a00/0xf210a9075089ec59 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216968.866974:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216968.867104:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714011520 00000100:00100000:2.0:1782216968.867114:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714011520 00000100:00100000:2.0:1782216968.867173:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 18 00000100:00100000:2.0:1782216968.867184:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:9681:x1868789714011520:12345-192.168.203.19@tcp:101:chown.0 00010000:00010000:2.0:1782216968.867207:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216968.867230:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d3a00/0xf210a9075089ec60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620220 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216968.867293:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d2400/0xf210a9075089ec67 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216968.867305:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d2400/0xf210a9075089ec67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216968.867316:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d2400/0xf210a9075089ec67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782216968.867374:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1782216968.867379:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1782216968.867418:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d2400/0xf210a9075089ec67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216968.867443:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d3a00/0xf210a9075089ec60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620220 expref: 9 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216968.867460:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d2400/0xf210a9075089ec67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620220 expref: 8 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216968.867468:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e65417fa00) 00010000:00010000:2.0:1782216968.867471:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782216968.867486:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67a2d2400, rc 0) 00000100:00100000:2.0:1782216968.867545:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+8:9681:x1868789714011520:12345-192.168.203.19@tcp:101:chown.0 Request processed in 363us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216968.867552:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 18 00000100:00100000:2.0:1782216968.869958:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216968.870051:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714011648 00000100:00100000:3.0:1782216968.870060:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714011648 00000100:00100000:3.0:1782216968.870158:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 19 00000100:00100000:3.0:1782216968.870168:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652500700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+8:9681:x1868789714011648:12345-192.168.203.19@tcp:101:chown.0 00010000:00010000:3.0:1782216968.870189:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782216968.870208:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030a00/0xf210a9075089ec6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620227 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.870269:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031400/0xf210a9075089ec75 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.870297:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031400/0xf210a9075089ec75 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.870308:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031400/0xf210a9075089ec75 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.870323:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ec7c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.870331:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ec7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.870337:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ec7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.870424:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030400/0xf210a9075089ec83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.870433:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030400/0xf210a9075089ec83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.870441:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030400/0xf210a9075089ec83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782216968.870478:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:3.0:1782216968.870482:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782216968.870505:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030400/0xf210a9075089ec83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.870517:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031400/0xf210a9075089ec75 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.870534:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031400/0xf210a9075089ec75 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.870541:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031400/0xf210a9075089ec75 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.870547:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640031400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782216968.870551:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031400/0xf210a9075089ec75 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.870559:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031400/0xf210a9075089ec75 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.870570:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e65417fa00) 00010000:00010000:3.0:1782216968.870573:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782216968.870578:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031400/0xf210a9075089ec75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.870585:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031400/0xf210a9075089ec75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.870598:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ec7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.870605:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ec7c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.870611:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ec7c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.870845:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640031e00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782216968.870854:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ec7c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.870861:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ec7c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.870869:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff88e650a64000) 00010000:00010000:3.0:1782216968.870872:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782216968.870906:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ec7c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.870914:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ec7c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.870946:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030a00/0xf210a9075089ec6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620227 expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.870959:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030400/0xf210a9075089ec83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620227 expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.870967:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88e650a64100) 00010000:00010000:3.0:1782216968.870969:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782216968.870971:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e640030400, rc 0) 00000100:00100000:3.0:1782216968.871140:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652500700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+9:9681:x1868789714011648:12345-192.168.203.19@tcp:101:chown.0 Request processed in 972us (1189us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216968.871148:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 19 00000100:00100000:0.0:1782216968.879485:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216968.879560:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714011904 00000100:00100000:2.0:1782216968.879570:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714011904 00000100:00100000:2.0:1782216968.879635:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 20 00000100:00100000:2.0:1782216968.879666:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64846ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+9:9681:x1868789714011904:12345-192.168.203.19@tcp:36:chown.0 00010000:00010000:2.0:1782216968.879718:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782216968.879743:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030400/0xf210a9075089ec83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620227 expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216968.879762:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88e650a64100) 00010000:00010000:2.0:1782216968.879773:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782216968.879799:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d3400/0xf210a9075089ec8a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216968.879811:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d3400/0xf210a9075089ec8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216968.879821:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d3400/0xf210a9075089ec8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782216968.948246:0:5785:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000065a3481 reply state 00000000f4b4ca75 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d3400/0xf210a9075089ec8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216968.948264:0:5785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782216968.948410:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1782216968.948517:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64846ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+10:9681:x1868789714011904:12345-192.168.203.19@tcp:36:chown.0 Request processed in 68859us (69040us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1782216968.948534:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 20 00000001:00080000:2.0:1782216968.951186:0:5805:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:2.0:1782216968.951228:0:5805:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:0.0:1782216968.951423:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d3400/0xf210a9075089ec8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216968.951435:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d3400/0xf210a9075089ec8a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216968.951443:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d3400/0xf210a9075089ec8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216968.951471:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67a2d3400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782216968.951475:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d3400/0xf210a9075089ec8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216968.951483:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d3400/0xf210a9075089ec8a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216968.951501:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88e65417f100) 00010000:00010000:0.0:1782216968.951504:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782216968.951509:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d3400/0xf210a9075089ec8a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216968.951516:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d3400/0xf210a9075089ec8a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216968.974985:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216968.975133:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714012032 00000100:00100000:1.0:1782216968.975150:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714012032 00000100:00100000:1.0:1782216968.975200:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 21 00000100:00100000:1.0:1782216968.975210:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:9682:x1868789714012032:12345-192.168.203.19@tcp:101:touch.500 00010000:00010000:1.0:1782216968.975233:0:6855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782216968.975252:0:6855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089ec91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62022e expref: -99 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782216968.980031:0:6855:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4732us 00010000:00010000:3.0:1782216968.994426:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030a00/0xf210a9075089ec98 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.994448:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030a00/0xf210a9075089ec98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.994470:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030a00/0xf210a9075089ec98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.994485:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ec9f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.994491:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ec9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.994497:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ec9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.994979:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031400/0xf210a9075089eca6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.994989:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031400/0xf210a9075089eca6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.994998:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031400/0xf210a9075089eca6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782216968.995076:0:6855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782216968.995080:0:6855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782216968.995376:0:6855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031400/0xf210a9075089eca6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.995389:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030a00/0xf210a9075089ec98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.995394:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030a00/0xf210a9075089ec98 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.995410:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030a00/0xf210a9075089ec98 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.995417:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640030a00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782216968.995421:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030a00/0xf210a9075089ec98 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.995428:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030a00/0xf210a9075089ec98 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.995439:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e65417fa00) 00010000:00010000:3.0:1782216968.995442:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782216968.995447:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030a00/0xf210a9075089ec98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.995453:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030a00/0xf210a9075089ec98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.995466:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ec9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.995472:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ec9f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.995476:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ec9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.995481:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640031e00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782216968.995483:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ec9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.995497:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ec9f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.995505:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff88e650a64000) 00010000:00010000:3.0:1782216968.995507:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782216968.995510:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ec9f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.995516:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ec9f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.995554:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089ec91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62022e expref: 8 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.995569:0:6855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031400/0xf210a9075089eca6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62022e expref: 7 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216968.995576:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88e650a64800) 00010000:00010000:3.0:1782216968.995578:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782216968.995580:0:6855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e640031400, rc 0) 00000100:00100000:3.0:1782216968.995795:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:9682:x1868789714012032:12345-192.168.203.19@tcp:101:touch.500 Request processed in 20584us (20816us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216968.995805:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 21 00000100:00100000:0.0:1782216969.006303:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216969.006372:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714012288 00000100:00100000:1.0:1782216969.006380:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714012288 00000100:00100000:1.0:1782216969.006430:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 22 00000100:00100000:1.0:1782216969.006439:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648545500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:9682:x1868789714012288:12345-192.168.203.19@tcp:101:touch.500 00010000:00010000:1.0:1782216969.006474:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782216969.006492:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089ecad lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620235 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.006808:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ecb4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.006823:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ecb4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.006835:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ecb4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.006849:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089ecbb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.006857:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089ecbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.006864:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089ecbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782216969.007671:0:5783:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1782216969.007982:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089ecc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.007995:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089ecc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.008004:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089ecc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.008048:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ecb4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.008057:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ecb4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.008064:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ecb4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.008071:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06c00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782216969.008076:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ecb4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.008084:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ecb4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.008094:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88e650a64800) 00010000:00010000:1.0:1782216969.008097:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782216969.008101:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ecb4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.008106:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ecb4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782216969.008118:0:5783:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000103cea3f reply state 00000000fe3031df transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089ecbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216969.008127:0:5783:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782216969.008159:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089ecad lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620235 expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.008186:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089ecc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620235 expref: 9 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.008193:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88e67a811c00) 00010000:00010000:1.0:1782216969.008195:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782216969.008197:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd07600, rc 0) 00000100:00100000:1.0:1782216969.008263:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648545500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+10:9682:x1868789714012288:12345-192.168.203.19@tcp:101:touch.500 Request processed in 1824us (1967us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1782216969.008271:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 22 00000100:00100000:0.0:1782216969.015974:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216969.016155:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714012544 00000100:00100000:1.0:1782216969.016166:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714012544 00000100:00100000:1.0:1782216969.016219:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 23 00000100:00100000:1.0:1782216969.016228:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648545180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+10:9682:x1868789714012544:12345-192.168.203.19@tcp:36:touch.500 00010000:00010000:1.0:1782216969.016286:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782216969.016315:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089ecc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620235 expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.016330:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88e67a811c00) 00010000:00010000:1.0:1782216969.016340:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782216969.016380:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ecd0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.016393:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ecd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.016402:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ecd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782216969.016544:0:5784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000027f5a382 reply state 00000000fd993120 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ecd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216969.016554:0:5784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782216969.016655:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648545180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+11:9682:x1868789714012544:12345-192.168.203.19@tcp:36:touch.500 Request processed in 426us (688us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1782216969.016662:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 23 00010000:00010000:3.0:1782216969.016888:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089ecbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216969.016898:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089ecbb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216969.016915:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089ecbb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216969.016922:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782216969.016926:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089ecbb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216969.016934:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089ecbb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216969.016943:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x6fc107fe (ffff88e67a811000) 00010000:00010000:3.0:1782216969.016946:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782216969.016950:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089ecbb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216969.016956:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089ecbb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216969.024054:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00010000:00010000:1.0:1782216969.024275:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ecd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.024289:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ecd0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.024296:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ecd0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.024303:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07a00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782216969.024307:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ecd0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.024314:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ecd0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.024329:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88e67a811a00) 00010000:00010000:1.0:1782216969.024332:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782216969.024337:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ecd0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.024344:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ecd0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216969.024455:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714012672 00000100:00100000:2.0:1782216969.024464:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714012672 00000100:00100000:2.0:1782216969.024515:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 24 00000100:00100000:2.0:1782216969.024525:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+9:9682:x1868789714012672:12345-192.168.203.19@tcp:101:touch.500 00010000:00010000:2.0:1782216969.024545:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216969.024561:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d3a00/0xf210a9075089ecd7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62023c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216969.024614:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d3a00/0xf210a9075089ecd7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62023c expref: 10 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216969.024628:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d3a00/0xf210a9075089ecd7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62023c expref: 10 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216969.024656:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88e65417f500) 00010000:00010000:2.0:1782216969.024660:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782216969.024662:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67a2d3a00, rc 0) 00000100:00100000:2.0:1782216969.024717:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+10:9682:x1868789714012672:12345-192.168.203.19@tcp:101:touch.500 Request processed in 194us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216969.024725:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 24 00000100:00100000:0.0:1782216969.029324:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216969.029421:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714012800 00000100:00100000:2.0:1782216969.029431:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714012800 00000100:00100000:2.0:1782216969.029475:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 17 00000100:00100000:2.0:1782216969.029482:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2355:x1868789714012800:12345-192.168.203.19@tcp:8:touch.500 00010000:00080000:2.0:1782216969.029526:0:6578:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 10ba4d21-74e8-42e8-8e52-48a327751cbd@192.168.203.19@tcp t0 exp 0000000000000000 cur 288 last 0 00000020:00000080:2.0:1782216969.029558:0:6578:0:(genops.c:1406:class_connect()) connect: client 10ba4d21-74e8-42e8-8e52-48a327751cbd, cookie 0xf210a9075089ecde 00002000:00100000:2.0:1782216969.029569:0:6578:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 10ba4d21-74e8-42e8-8e52-48a327751cbd/ffff88e67a470800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782216969.029589:0:6578:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782216969.029812:0:6578:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1782216969.029843:0:6578:0:(import.c:65:import_set_state_nolock()) ffff88e67a471000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782216969.029944:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2355:x1868789714012800:12345-192.168.203.19@tcp:8:touch.500 Request processed in 460us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216969.029951:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 17 00000100:00100000:0.0:1782216969.043241:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216969.043424:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714012928 00000100:00100000:2.0:1782216969.043434:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714012928 00000100:00100000:2.0:1782216969.043497:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 18 00000100:00100000:2.0:1782216969.043506:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a817b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:0:x1868789714012928:12345-192.168.203.19@tcp:2:touch.500 00000100:00080000:3.0:1782216969.043677:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782216969.115320:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a817b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:0:x1868789714012928:12345-192.168.203.19@tcp:2:touch.500 Request processed in 71806us (72080us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1782216969.115334:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 18 00000001:00080000:1.0:1782216969.115588:0:7488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:1.0:1782216969.115597:0:7488:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 10ba4d21-74e8-42e8-8e52-48a327751cbd 00000100:00100000:0.0:1782216969.119160:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216969.119241:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714013184 00000100:00100000:1.0:1782216969.119250:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714013184 00000100:00100000:1.0:1782216969.119306:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 2 00000100:00100000:1.0:1782216969.119316:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+10:9682:x1868789714013184:12345-192.168.203.19@tcp:35:touch.500 00000100:00100000:1.0:1782216969.119631:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+11:9682:x1868789714013184:12345-192.168.203.19@tcp:35:touch.500 Request processed in 316us (478us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1782216969.119648:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 2 00000100:00100000:2.0:1782216969.140870:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216969.141100:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714013312 00000100:00100000:1.0:1782216969.141110:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714013312 00000100:00100000:1.0:1782216969.141167:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 25 00000100:00100000:1.0:1782216969.141178:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+11:9683:x1868789714013312:12345-192.168.203.19@tcp:101:rm.0 00010000:00010000:1.0:1782216969.141200:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782216969.141220:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ece5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620243 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.141283:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089ecec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.141297:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089ecec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.141309:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089ecec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782216969.141366:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782216969.141381:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1782216969.141423:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089ecec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.141450:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ece5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620243 expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.141468:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089ecec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620243 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.141477:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88e650a64800) 00010000:00010000:1.0:1782216969.141480:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782216969.141484:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd07600, rc 0) 00000100:00100000:1.0:1782216969.141544:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+12:9683:x1868789714013312:12345-192.168.203.19@tcp:101:rm.0 Request processed in 368us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216969.141551:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 25 00000100:00100000:2.0:1782216969.145619:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782216969.145760:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714013568 00000100:00100000:0.0:1782216969.145777:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714013568 00000100:00100000:0.0:1782216969.145852:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 26 00000100:00100000:0.0:1782216969.145865:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+12:9683:x1868789714013568:12345-192.168.203.19@tcp:101:rm.0 00010000:00010000:0.0:1782216969.145963:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216969.145990:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089ecf3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62024a expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782216969.146159:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1782216969.146353:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089ecf3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62024a expref: 14 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216969.146371:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e65417fa00) 00010000:00010000:0.0:1782216969.146374:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782216969.146380:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089ecf3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62024a expref: 14 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216969.146396:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437ba00, rc 0) 00000100:00100000:0.0:1782216969.146461:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+13:9683:x1868789714013568:12345-192.168.203.19@tcp:101:rm.0 Request processed in 599us (860us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1782216969.146469:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 26 00000100:00100000:0.0:1782216969.151313:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216969.151408:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714013696 00000100:00100000:1.0:1782216969.151422:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714013696 00000100:00100000:1.0:1782216969.151489:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 3 00000100:00100000:1.0:1782216969.151500:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+13:9683:x1868789714013696:12345-192.168.203.19@tcp:37:rm.0 00000100:00100000:1.0:1782216969.156291:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+13:9683:x1868789714013696:12345-192.168.203.19@tcp:37:rm.0 Request processed in 4775us (4976us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216969.156309:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 3 00000100:00100000:2.0:1782216969.160527:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782216969.161296:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714013952 00000100:00100000:0.0:1782216969.161311:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714013952 00000100:00100000:0.0:1782216969.161423:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 4 00000100:00100000:0.0:1782216969.161436:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664ed3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+13:9683:x1868789714013952:12345-192.168.203.19@tcp:35:rm.0 00000100:00100000:0.0:1782216969.161804:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664ed3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+14:9683:x1868789714013952:12345-192.168.203.19@tcp:35:rm.0 Request processed in 369us (1291us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1782216969.161812:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 4 00000100:00100000:0.0:1782216969.165279:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216969.165523:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714014208 00000100:00100000:1.0:1782216969.165538:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714014208 00000100:00100000:1.0:1782216969.165619:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 27 00000100:00100000:1.0:1782216969.165632:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+14:9683:x1868789714014208:12345-192.168.203.19@tcp:101:rm.0 00010000:00010000:1.0:1782216969.165796:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782216969.165831:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ed01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620251 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.166129:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089ed08 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.166303:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089ed08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.166319:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089ed08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782216969.166334:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1782216969.166496:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ed01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620251 expref: 17 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.166518:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089ed08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620251 expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.166528:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88e650a64800) 00010000:00010000:1.0:1782216969.166532:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782216969.166536:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd07e00, rc 0) 00000100:00100000:1.0:1782216969.166627:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+16:9683:x1868789714014208:12345-192.168.203.19@tcp:101:rm.0 Request processed in 997us (1366us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1782216969.166636:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 27 00000100:00100000:2.0:1782216969.171863:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782216969.172129:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733969920:0@lo:400:kworker.0 00000100:00100000:2.0:1782216969.172141:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1868789733970048:0@lo:400:kworker.0 00000100:00100000:3.0:1782216969.172226:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a815880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:526a4802-b871-4bcf-870f-067f11655366:3302:1868789733969664:0@lo:400:kworker.0 00000100:00100000:3.0:1782216969.172280:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216969.172335:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a817800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1868789733970176:0@lo:400:kworker.0 00000100:00100000:3.0:1782216969.172364:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868789733969792:0@lo:400:kworker.0 00000100:00100000:3.0:1782216969.172396:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733969664 00000100:00100000:3.0:1782216969.172404:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733969664 00000100:00100000:3.0:1782216969.172456:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1782216969.172478:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+19:3302:x1868789733969664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216969.172556:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+19:3302:x1868789733969664:12345-0@lo:400:kworker.0 Request processed in 92us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216969.172564:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1782216969.172840:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216969.172973:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733969920 00000100:00100000:3.0:1782216969.172977:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733969920 00000100:00100000:3.0:1782216969.173015:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1782216969.173027:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a817100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733969920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216969.173069:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a817100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733969920:12345-0@lo:400:kworker.0 Request processed in 48us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216969.173076:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1782216969.173093:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782216969.173268:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67a814000 x1868789733969920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216969.173283:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733969920:0@lo:400:kworker.0 00000100:00100000:1.0:1782216969.173381:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714014336 00000100:00100000:2.0:1782216969.173388:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216969.173389:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714014336 00000100:00100000:1.0:1782216969.173430:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733970048 00000100:00100000:1.0:1782216969.173433:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733970048 00000100:00100000:2.0:1782216969.173443:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216969.173460:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733970176 00000100:00100000:1.0:1782216969.173473:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733970176 00000100:00100000:2.0:1782216969.173477:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a815880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:526a4802-b871-4bcf-870f-067f11655366:3302:1868789733969664:0@lo:400:kworker.0 00000100:00100000:1.0:1782216969.173498:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1782216969.173504:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216969.173509:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652503480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1868789733970048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216969.173525:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733970304:0@lo:400:kworker.0 00000100:00100000:2.0:1782216969.173563:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216969.173570:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652503480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1868789733970048:12345-0@lo:400:kworker.0 Request processed in 64us (1369us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216969.173579:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1782216969.173599:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733969792 00000100:00100000:1.0:1782216969.173603:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733969792 00000100:00100000:1.0:1782216969.173618:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1782216969.173623:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652503800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1868789733970176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216969.173670:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652503800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1868789733970176:12345-0@lo:400:kworker.0 Request processed in 46us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216969.173676:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1782216969.173687:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1782216969.173693:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868789733969792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216969.173725:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868789733969792:12345-0@lo:400:kworker.0 Request processed in 32us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216969.173730:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1782216969.173742:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 28 00000100:00100000:1.0:1782216969.173748:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+16:9683:x1868789714014336:12345-192.168.203.19@tcp:41:rm.0 00000004:00000024:1.0:1782216969.173806:0:5783:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1782216969.173862:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+16:9683:x1868789714014336:12345-192.168.203.19@tcp:41:rm.0 Request processed in 114us (2013us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216969.173869:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 28 00000100:00080000:1.0:1782216969.173902:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782216969.173926:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a817800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1868789733970176:0@lo:400:kworker.0 00000100:00100000:1.0:1782216969.173958:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868789733969792:0@lo:400:kworker.0 00000100:00100000:1.0:1782216969.173977:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1868789733970048:0@lo:400:kworker.0 00000100:00100000:0.0:1782216969.174232:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733970304 00000100:00100000:0.0:1782216969.174237:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733970304 00000100:00100000:0.0:1782216969.174283:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1782216969.174291:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733970304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216969.174334:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733970304:12345-0@lo:400:kworker.0 Request processed in 44us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216969.174341:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1782216969.174368:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67a816d80 x1868789733970304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216969.174377:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733970304:0@lo:400:kworker.0 00000100:00080000:3.0:1782216969.175976:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782216969.177442:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216969.178494:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714014464 00000100:00100000:2.0:1782216969.178509:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714014464 00000100:00100000:2.0:1782216969.178592:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 29 00000100:00100000:2.0:1782216969.178605:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+16:9683:x1868789714014464:12345-192.168.203.19@tcp:101:rm.0 00010000:00010000:2.0:1782216969.178631:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216969.178667:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d2a00/0xf210a9075089ed16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620258 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216969.178748:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d3400/0xf210a9075089ed1d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216969.178766:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d3400/0xf210a9075089ed1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216969.178781:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d3400/0xf210a9075089ed1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216969.178823:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089ed24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216969.178832:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089ed24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216969.178840:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089ed24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216969.179031:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089ed2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216969.179040:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089ed2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216969.179059:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089ed2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782216969.179093:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1782216969.179098:0:5783:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782216969.179122:0:5783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089ed2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216969.179135:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089ed2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216969.179145:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d3400/0xf210a9075089ed1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216969.179153:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d3400/0xf210a9075089ed1d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216969.179161:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d3400/0xf210a9075089ed1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216969.179168:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67a2d3400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782216969.179172:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d3400/0xf210a9075089ed1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216969.179180:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d3400/0xf210a9075089ed1d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216969.179194:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88e650a64800) 00010000:00010000:2.0:1782216969.179197:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782216969.179202:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d3400/0xf210a9075089ed1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216969.179218:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d3400/0xf210a9075089ed1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216969.179235:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089ed24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216969.179242:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089ed24 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216969.179248:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089ed24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216969.179253:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738af400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782216969.179256:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089ed24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216969.179263:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089ed24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216969.179271:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x6fc107fe (ffff88e65417f200) 00010000:00010000:2.0:1782216969.179274:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782216969.179277:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089ed24 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216969.179283:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089ed24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216969.183086:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d2a00/0xf210a9075089ed16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620258 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216969.183124:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089ed2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620258 expref: 17 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216969.183226:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88e65417f500) 00010000:00010000:2.0:1782216969.183230:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782216969.183233:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738ae200, rc 0) 00000100:00100000:2.0:1782216969.183357:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+17:9683:x1868789714014464:12345-192.168.203.19@tcp:101:rm.0 Request processed in 4752us (5925us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216969.183367:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 29 00000100:00100000:0.0:1782216969.190441:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216969.192952:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714014720 00000100:00100000:1.0:1782216969.192972:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714014720 00000100:00100000:1.0:1782216969.193078:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 30 00000100:00100000:1.0:1782216969.193218:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+17:9683:x1868789714014720:12345-192.168.203.19@tcp:36:rm.0 00010000:00010000:1.0:1782216969.193362:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1782216969.193397:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089ed2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620258 expref: 17 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.193424:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d3a00/0xf210a9075089ecd7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62023c expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.193437:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88e65417f500) 00010000:00010000:1.0:1782216969.193456:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089ecec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620243 expref: 15 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.193465:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88e650a64800) 00010000:00010000:1.0:1782216969.193469:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782216969.193492:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ed32 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.193507:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ed32 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.193518:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ed32 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.193558:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ed39 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.193566:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ed39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.193573:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ed39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.199511:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089ed40 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.199545:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089ed40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.199560:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089ed40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782216969.206625:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1782216969.206655:0:5784:0:(osp_sync.c:1862:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 288258777471ns, next at 289258773041ns, rc = 0 00010000:00010000:1.0:1782216969.206755:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07c00/0xf210a9075089ed47 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.206776:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07c00/0xf210a9075089ed47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.206790:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07c00/0xf210a9075089ed47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.206800:0:5784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07c00/0xf210a9075089ed47 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.206822:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07c00/0xf210a9075089ed47 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.206827:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07c00/0xf210a9075089ed47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.206865:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782216969.206931:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089ed40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.206938:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089ed40 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.206944:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089ed40 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.206950:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06600 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782216969.206956:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089ed40 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.206964:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089ed40 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.206978:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88e67a811a00) 00010000:00010000:1.0:1782216969.206982:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782216969.206987:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089ed40 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.206994:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089ed40 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.207016:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ed32 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.207029:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ed32 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.207035:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ed32 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.207041:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07a00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782216969.207044:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ed32 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.207050:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ed32 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.207059:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88e650a64800) 00010000:00010000:1.0:1782216969.207061:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782216969.207064:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ed32 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.207069:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ed32 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782216969.207080:0:5784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001a6a0227 reply state 0000000014f372cf transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ed39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216969.207092:0:5784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782216969.207205:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+16:9683:x1868789714014720:12345-192.168.203.19@tcp:36:rm.0 Request processed in 13988us (16773us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1782216969.207217:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 30 00010000:00010000:2.0:1782216969.208759:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782216969.208772:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07c00/0xf210a9075089ed47 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216969.208782:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07c00 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:2.0:1782216969.208787:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07c00/0xf210a9075089ed47 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216969.208798:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07c00/0xf210a9075089ed47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216969.208816:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88e67a811a00) 00010000:00010000:2.0:1782216969.208819:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782216969.208824:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07c00/0xf210a9075089ed47 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216969.208829:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07c00/0xf210a9075089ed47 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216969.208855:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216969.208856:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216969.208858:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216969.213313:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ed39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216969.213335:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ed39 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216969.213343:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ed39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216969.213350:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06c00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782216969.213356:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ed39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216969.213364:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ed39 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216969.213384:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x6fc107fe (ffff88e67a811c00) 00010000:00010000:3.0:1782216969.213388:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782216969.213415:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ed39 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216969.213422:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ed39 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216969.216687:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216969.219676:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714014976 00000100:00100000:1.0:1782216969.219696:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714014976 00000100:00100000:1.0:1782216969.220705:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 5 00000100:00100000:1.0:1782216969.220720:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+15:9683:x1868789714014976:12345-192.168.203.19@tcp:35:rm.0 00000100:00100000:1.0:1782216969.221111:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+16:9683:x1868789714014976:12345-192.168.203.19@tcp:35:rm.0 Request processed in 392us (4436us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1782216969.221120:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 5 00000100:00100000:0.0:1782216969.226998:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216969.227231:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714015232 00000100:00100000:3.0:1782216969.227244:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714015232 00000100:00100000:3.0:1782216969.227382:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 31 00000100:00100000:3.0:1782216969.227394:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+16:9683:x1868789714015232:12345-192.168.203.19@tcp:36:rm.0 00010000:00010000:3.0:1782216969.227468:0:6855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1782216969.227502:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089ed08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620251 expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216969.227531:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031400/0xf210a9075089eca6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62022e expref: 15 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216969.227544:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88e650a64800) 00010000:00010000:3.0:1782216969.227564:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67a2d2400/0xf210a9075089ec67 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620220 expref: 14 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216969.227574:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e65417fa00) 00010000:00010000:3.0:1782216969.227582:0:6855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782216969.227611:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ed4e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216969.227626:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ed4e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216969.227647:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ed4e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216969.230467:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030a00/0xf210a9075089ed55 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216969.230484:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030a00/0xf210a9075089ed55 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216969.230497:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030a00/0xf210a9075089ed55 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216969.230935:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089ed5c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216969.230944:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089ed5c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216969.230952:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089ed5c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782216969.238122:0:6855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1782216969.238185:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089ed5c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216969.238198:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089ed5c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216969.238206:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089ed5c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216969.238213:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640030200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782216969.238218:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089ed5c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216969.238248:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089ed5c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216969.238269:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88e650a64700) 00010000:00010000:3.0:1782216969.238273:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782216969.238279:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089ed5c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216969.238286:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089ed5c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216969.238324:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ed4e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216969.238331:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ed4e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216969.238337:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ed4e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216969.238342:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640031e00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782216969.238345:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ed4e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216969.238351:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ed4e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216969.238358:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e650a64000) 00010000:00010000:3.0:1782216969.238360:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782216969.238363:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ed4e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216969.238380:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ed4e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782216969.238396:0:6855:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000012c4b1b8 reply state 00000000a29222d1 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030a00/0xf210a9075089ed55 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216969.238406:0:6855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782216969.238539:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+15:9683:x1868789714015232:12345-192.168.203.19@tcp:36:rm.0 Request processed in 11141us (11561us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1782216969.238549:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 31 00010000:00010000:1.0:1782216969.253156:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030a00/0xf210a9075089ed55 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.253178:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030a00/0xf210a9075089ed55 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.253187:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030a00/0xf210a9075089ed55 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.253194:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640030a00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782216969.253200:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030a00/0xf210a9075089ed55 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.253209:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030a00/0xf210a9075089ed55 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.253230:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff88e650a64f00) 00010000:00010000:1.0:1782216969.253234:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782216969.253240:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030a00/0xf210a9075089ed55 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216969.253247:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030a00/0xf210a9075089ed55 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216969.686314:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733970432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782216969.686439:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216969.687061:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733970432 00000100:00100000:0.0:1782216969.687071:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733970432 00000100:00100000:0.0:1782216969.687182:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1782216969.687194:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733970432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782216969.687224:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782216969.687283:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733970432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216969.687299:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1782216969.687379:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67a814380 x1868789733970432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216985 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216969.687401:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733970432:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782216969.812862:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216970.836129:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216971.860765:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782216972.244761:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733970560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782216972.244834:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216972.245002:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733970560 00000100:00100000:0.0:1782216972.245010:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733970560 00000100:00100000:0.0:1782216972.245069:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1782216972.245079:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6454a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733970560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782216972.245111:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782216972.245171:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6454a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733970560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216972.245178:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1782216972.245291:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e652500a80 x1868789733970560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216988 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216972.245318:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733970560:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782216972.245414:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782216972.900851:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216973.307387:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216973.308360:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714015360 00000100:00100000:3.0:1782216973.308376:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714015360 00000100:00100000:3.0:1782216973.308461:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 248 00000100:00100000:3.0:1782216973.308474:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2358:x1868789714015360:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:3.0:1782216973.308581:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2358:x1868789714015360:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 109us (1207us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216973.308590:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 248 00000100:00100000:2.0:1782216973.313271:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216973.313992:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714015488 00000100:00100000:1.0:1782216973.314007:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714015488 00000100:00100000:1.0:1782216973.314086:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 99 00000100:00100000:1.0:1782216973.314098:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+14:2358:x1868789714015488:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:1.0:1782216973.314182:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+14:2358:x1868789714015488:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 87us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216973.314191:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 99 00000100:00080000:3.0:1782216973.314351:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782216973.324426:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216973.324468:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216973.324502:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714015744 00000100:00100000:1.0:1782216973.324509:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714015616 00000100:00100000:2.0:1782216973.324520:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714015744 00000100:00100000:1.0:1782216973.324521:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714015616 00000100:00100000:1.0:1782216973.324606:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 57 00000100:00100000:1.0:1782216973.324629:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6454aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2359:x1868789714015616:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:1.0:1782216973.324700:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6454aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2359:x1868789714015616:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 75us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216973.324707:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 57 00000100:00100000:2.0:1782216973.325916:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 100 00000100:00100000:2.0:1782216973.325934:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6454a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2359:x1868789714015744:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:2.0:1782216973.326018:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6454a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2359:x1868789714015744:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 90us (1599us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216973.326026:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 100 00000100:00080000:1.0:1782216973.327381:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782216973.327391:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:2.0:1782216973.445102:0:11463:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1782216973.908966:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216974.294419:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652502300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1868789733971072:0@lo:400:kworker.0 00000100:00100000:2.0:1782216974.294512:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216974.294575:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782216974.294581:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652502a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:526a4802-b871-4bcf-870f-067f11655366:3301:1868789733970688:0@lo:400:kworker.0 00000100:00100000:2.0:1782216974.294623:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216974.294649:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652502680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1868789733971200:0@lo:400:kworker.0 00000100:00100000:2.0:1782216974.294672:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216974.294700:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652501500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868789733970816:0@lo:400:kworker.0 00000100:00100000:2.0:1782216974.294724:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216974.294741:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e646104e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733971328:0@lo:400:kworker.0 00000100:00100000:2.0:1782216974.294765:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216974.294785:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782216974.294791:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733970944:0@lo:400:kworker.0 00000100:00100000:2.0:1782216974.294826:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216974.294996:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733971072 00000100:00100000:2.0:1782216974.295006:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733971072 00000100:00100000:2.0:1782216974.295063:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733971200 00000100:00100000:2.0:1782216974.295066:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733971200 00000100:00100000:2.0:1782216974.295079:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733970816 00000100:00100000:2.0:1782216974.295081:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733970816 00000100:00100000:2.0:1782216974.295096:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1782216974.298724:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1782216974.298730:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e646107b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1868789733971072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216974.298737:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e646104700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1868789733971200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216974.299191:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e646104700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1868789733971200:12345-0@lo:400:kworker.0 Request processed in 455us (4514us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216974.299200:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1782216974.299233:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1782216974.299240:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e646105880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868789733970816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216974.299399:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e646105880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868789733970816:12345-0@lo:400:kworker.0 Request processed in 158us (4673us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216974.299405:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1782216974.300211:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e646107b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1868789733971072:12345-0@lo:400:kworker.0 Request processed in 1490us (5697us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216974.300220:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1782216974.300317:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733970688 00000100:00100000:2.0:1782216974.300327:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733970688 00000100:00100000:2.0:1782216974.300368:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1782216974.300375:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e65774ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+19:3301:x1868789733970688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216974.300418:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e65774ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+19:3301:x1868789733970688:12345-0@lo:400:kworker.0 Request processed in 42us (5793us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216974.300424:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1782216974.300464:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733971328 00000100:00100000:2.0:1782216974.300469:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733971328 00000100:00100000:2.0:1782216974.300501:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733970944 00000100:00100000:2.0:1782216974.300505:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733970944 00000100:00100000:2.0:1782216974.300528:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782216974.300534:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e646105c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733971328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216974.300568:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e646105c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733971328:12345-0@lo:400:kworker.0 Request processed in 35us (5803us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216974.300575:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782216974.300597:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1782216974.300614:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e646104000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733970944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216974.300647:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e646104000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733970944:12345-0@lo:400:kworker.0 Request processed in 34us (5821us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216974.300653:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1782216974.300673:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782216974.300677:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782216974.300680:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1782216974.301264:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e652500a80 x1868789733970944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216974.301283:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733970944:0@lo:400:kworker.0 00000100:00100000:0.0:1782216974.301300:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652501500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868789733970816:0@lo:400:kworker.0 00010000:00080000:0.0:1782216974.301312:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e646104e00 x1868789733971328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216974.301321:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e646104e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733971328:0@lo:400:kworker.0 00000100:00100000:1.0:1782216974.301533:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652502680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1868789733971200:0@lo:400:kworker.0 00000100:00100000:1.0:1782216974.301559:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652502300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1868789733971072:0@lo:400:kworker.0 00000100:00100000:1.0:1782216974.302435:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652502a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:526a4802-b871-4bcf-870f-067f11655366:3301:1868789733970688:0@lo:400:kworker.0 00000001:00080000:2.0:1782216974.373374:0:5805:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967304 is committed 00000001:00080000:2.0:1782216974.373398:0:5805:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:2.0:1782216974.373406:0:5805:0:(osp_sync.c:1827:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1782216974.373440:0:5805:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:2.0:1782216974.375142:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782216974.375174:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733971456:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782216974.375269:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216974.375393:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733971456 00000100:00100000:3.0:1782216974.375403:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733971456 00000100:00100000:3.0:1782216974.375468:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782216974.375480:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e646107480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733971456:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1782216974.375516:0:6579:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1782216974.375559:0:6579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a3a7908, atime: 0x6a3a7908, ctime: 0x6a3a7908, blocks: 0x1 00010000:00010000:3.0:1782216974.375569:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef6b345a/0xf210a9075089ed63 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216974.375590:0:6579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=293s v=(0 0) 00010000:00010000:3.0:1782216974.375595:0:6579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782216974.375611:0:6579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef6b345a/0xf210a9075089ed63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216974.375634:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef6b345a/0xf210a9075089ed63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216974.375646:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef6b345a/0xf210a9075089ed63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216974.375669:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef6b345a/0xf210a9075089ed63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216974.375696:0:6579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782216974.375913:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782216974.375922:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef6b345a/0xf210a9075089ed63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216974.375931:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640031e00 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:1.0:1782216974.375935:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef6b345a/0xf210a9075089ed63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216974.375945:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef6b345a/0xf210a9075089ed63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216974.375968:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef6b345a/0xf210a9075089ed63 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216974.375976:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef6b345a/0xf210a9075089ed63 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216974.375999:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216974.376001:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216974.376002:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216974.376985:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e646107480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1868789733971456:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1503us (1713us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1782216974.376997:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000004:00080000:2.0:1782216974.377534:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88e67a1e5f80/2, rc 0, transno 4294967300 00000100:00100000:2.0:1782216974.377544:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733971456:0@lo:6:osp-syn-1-0.0 00000020:00000080:2.0:1782216974.797267:0:11512:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffebcebe700 20000000:00000080:2.0:1782216974.797284:0:11512:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88e67f295c00 uarg=0000000000000000 20000000:01000000:2.0:1782216974.797318:0:11512:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1782216974.797324:0:11512:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1782216974.797329:0:11512:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1782216974.799007:0:11513:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1782216974.799154:0:11512:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000100:00100000:3.0:1782216974.806626:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782216974.806647:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733971584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782216974.807570:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216974.807773:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733971584 00000100:00100000:1.0:1782216974.807781:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733971584 00000100:00100000:1.0:1782216974.807834:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1782216974.807854:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1868789733971584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782216974.807926:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782216974.807997:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1868789733971584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216974.808004:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1782216974.808059:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733971584:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1782216974.809713:0:11512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1782216974.809779:0:11512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1782216974.809839:0:11512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1782216974.809859:0:11512:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1782216974.809924:0:11512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88e640031400/0xf210a9075089ed6a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216974.809946:0:11512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88e67a2d3000/0xf210a9075089ec0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089ec05 expref: 18 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216974.809955:0:11512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88e640031200/0xf210a9075089ec1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089ec13 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216974.809963:0:11512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88e67a2d2200/0xf210a9075089ec28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089ec21 expref: 18 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216974.809975:0:11512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88e67fd07000/0xf210a9075089ec2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62020b expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216974.809997:0:11512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88e67a2d2600/0xf210a9075089ec36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620212 expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216974.810006:0:11512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88e640031400/0xf210a9075089ed6a lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216974.810053:0:11512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88e67a2d2600/0xf210a9075089ec36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620212 expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216974.810072:0:11512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88e67a2d2600/0xf210a9075089ec36 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620212 expref: 12 pid: 5778 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216974.810090:0:11512:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1e7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11512:1868789733971712:192.168.203.19@tcp:104: 00010000:00010000:3.0:1782216974.810212:0:11512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88e67fd07000/0xf210a9075089ec2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62020b expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216974.810222:0:11512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88e67fd07000/0xf210a9075089ec2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62020b expref: 12 pid: 5778 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216974.810231:0:11512:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a806680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11512:1868789733971840:192.168.203.19@tcp:104: 00010000:00010000:3.0:1782216974.810264:0:11512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88e67a2d2200/0xf210a9075089ec28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf210a9075089ec21 expref: 18 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216974.810273:0:11512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88e67a2d2200/0xf210a9075089ec28 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf210a9075089ec21 expref: 18 pid: 5775 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216974.810283:0:11512:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a807480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11512:1868789733971968:0@lo:104: 00000100:00100000:3.0:1782216974.810327:0:11512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782216974.810377:0:11512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88e640031200/0xf210a9075089ec1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf210a9075089ec13 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216974.810386:0:11512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88e640031200/0xf210a9075089ec1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf210a9075089ec13 expref: 18 pid: 5778 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216974.810394:0:11512:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a807100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11512:1868789733972096:0@lo:104: 00000100:00100000:3.0:1782216974.810423:0:11512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782216974.810446:0:11512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88e67a2d3000/0xf210a9075089ec0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf210a9075089ec05 expref: 18 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216974.810453:0:11512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88e67a2d3000/0xf210a9075089ec0c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf210a9075089ec05 expref: 18 pid: 5776 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216974.810461:0:11512:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a806d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11512:1868789733972224:0@lo:104: 00000100:00100000:3.0:1782216974.810480:0:11512:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e644494480 going to sleep for 11 seconds 00000100:00100000:1.0:1782216974.810785:0:5766:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1782216974.810828:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216974.810867:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733971968 00000100:00100000:1.0:1782216974.810890:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733971968 00000100:00100000:1.0:1782216974.810941:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733972096 00000100:00100000:1.0:1782216974.810945:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733972096 00000100:00100000:1.0:1782216974.810957:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733972224 00000100:00100000:1.0:1782216974.810958:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733972224 00000100:00100000:1.0:1782216974.810969:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782216974.810976:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a805f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:526a4802-b871-4bcf-870f-067f11655366+5:11512:x1868789733971968:12345-0@lo:104: 00010000:00010000:1.0:1782216974.810994:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.119@tcp lock: ffff88e67437a800/0xf210a9075089ec21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089ec28 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216974.811242:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782216974.811249:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a805f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:526a4802-b871-4bcf-870f-067f11655366+5:11512:x1868789733971968:12345-0@lo:104: Request processed in 273us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216974.811324:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782216974.811340:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f069050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:526a4802-b871-4bcf-870f-067f11655366+5:11512:x1868789733972096:12345-0@lo:104: 00010000:00010000:3.0:1782216974.811355:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.119@tcp lock: ffff88e67437ae00/0xf210a9075089ec13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089ec1a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216974.811415:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782216974.811422:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f069050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:526a4802-b871-4bcf-870f-067f11655366+5:11512:x1868789733972096:12345-0@lo:104: Request processed in 88us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216974.820543:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782216974.820690:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216974.820723:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216974.821152:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782216974.824050:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714016000 00000100:00100000:0.0:1782216974.824063:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714016000 00010000:00010000:0.0:1782216974.824109:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88e67fd07000/0xf210a9075089ec2f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62020b expref: 13 pid: 5778 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216974.824148:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714015872 00000100:00100000:0.0:1782216974.824152:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714015872 00010000:00010000:0.0:1782216974.824165:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88e67a2d2600/0xf210a9075089ec36 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620212 expref: 14 pid: 5778 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216974.824208:0:8300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 30 00000100:00100000:0.0:1782216974.824223:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 31 00000100:00100000:2.0:1782216974.824236:0:8300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6454a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+14:2359:x1868789714016000:12345-192.168.203.19@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1782216974.824238:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6454aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+14:2359:x1868789714015872:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782216974.824269:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782216974.824276:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88e67a2d2600/0xf210a9075089ec36 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620212 expref: 14 pid: 5778 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216974.824282:0:8300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782216974.824291:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88e67a2d2600/0xf210a9075089ec36 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620212 expref: 14 pid: 5778 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216974.824298:0:8300:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88e67fd07000/0xf210a9075089ec2f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62020b expref: 14 pid: 5778 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216974.824315:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782216974.824375:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6454aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+14:2359:x1868789714015872:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 141us (3650us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216974.824383:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 31 00010000:00010000:0.0:1782216974.824405:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782216974.824413:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e67437a800/0xf210a9075089ec21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089ec28 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216974.824438:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437a800 already unused, calling callback (ffffffffc1d2fc20) 10000000:00010000:0.0:1782216974.824443:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e67437a800/0xf210a9075089ec21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf210a9075089ec28 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216974.824452:0:8300:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88e67fd07000/0xf210a9075089ec2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62020b expref: 13 pid: 5778 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216974.824457:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e67437a800/0xf210a9075089ec21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf210a9075089ec28 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782216974.824475:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e67437a800/0xf210a9075089ec21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf210a9075089ec28 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216974.824481:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782216974.824569:0:8300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782216974.824641:0:8300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6454a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2359:x1868789714016000:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 417us (3952us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216974.824650:0:8300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 30 00000100:00100000:1.0:1782216974.826225:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782216974.826248:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6454a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:526a4802-b871-4bcf-870f-067f11655366+3:11512:x1868789733972224:12345-0@lo:104: 00010000:00010000:1.0:1782216974.826346:0:6593:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.119@tcp lock: ffff88e640031600/0xf210a9075089ec05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089ec0c expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216974.826983:0:11512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e67a2d2600/0xf210a9075089ec36 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620212 expref: 12 pid: 5778 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216974.827025:0:6593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782216974.827043:0:11512:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1e7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11512:1868789733971712:192.168.203.19@tcp:104: 00000100:00100000:1.0:1782216974.827095:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6454a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:526a4802-b871-4bcf-870f-067f11655366+3:11512:x1868789733972224:12345-0@lo:104: Request processed in 856us (16267us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216974.827104:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:2.0:1782216974.827157:0:11512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e67fd07000/0xf210a9075089ec2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62020b expref: 11 pid: 5778 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216974.827173:0:11512:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a806680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11512:1868789733971840:192.168.203.19@tcp:104: 00000100:00100000:2.0:1782216974.827189:0:11512:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a807480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11512:1868789733971968:0@lo:104: 00000100:00100000:2.0:1782216974.827206:0:11512:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a807100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11512:1868789733972096:0@lo:104: 00000100:00100000:2.0:1782216974.827226:0:11512:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a806d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11512:1868789733972224:0@lo:104: 00010000:00010000:2.0:1782216974.827266:0:11512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88e640031400/0xf210a9075089ed6a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216974.827978:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782216974.832364:0:11514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782216974.834370:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e67437ae00/0xf210a9075089ec13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089ec1a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216974.834389:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437ae00 already unused, calling callback (ffffffffc1d2fc20) 10000000:00010000:2.0:1782216974.834393:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e67437ae00/0xf210a9075089ec13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf210a9075089ec1a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216974.834416:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e67437ae00/0xf210a9075089ec13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf210a9075089ec1a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782216974.834424:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e67437ae00/0xf210a9075089ec13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf210a9075089ec1a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216974.834429:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782216974.837391:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: ffff88e67437a800/0xf210a9075089ec21 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089ec28 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216974.837416:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782216974.837459:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e67437a800/0xf210a9075089ec21 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089ec28 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216974.837478:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e67437a800/0xf210a9075089ec21 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089ec28 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216974.837531:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:526a4802-b871-4bcf-870f-067f11655366:3302:1868789733972352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782216974.837652:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782216974.837737:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216974.837739:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216974.837742:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216974.839905:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216974.839913:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216974.839916:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216974.840208:0:11514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e640031600/0xf210a9075089ec05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089ec0c expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216974.840225:0:11514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640031600 already unused, calling callback (ffffffffc1d2fc20) 10000000:00010000:1.0:1782216974.840230:0:11514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e640031600/0xf210a9075089ec05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf210a9075089ec0c expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216974.840263:0:11514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e640031600/0xf210a9075089ec05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf210a9075089ec0c expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782216974.840271:0:11514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e640031600/0xf210a9075089ec05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf210a9075089ec0c expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782216974.840278:0:11514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1782216974.840431:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733972352 00000100:00100000:3.0:1782216974.840448:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733972352 00010000:00010000:3.0:1782216974.840506:0:8299:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88e67a2d2200/0xf210a9075089ec28 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089ec21 expref: 19 pid: 5775 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216974.840547:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782216974.840569:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652483b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:526a4802-b871-4bcf-870f-067f11655366+19:3302:x1868789733972352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782216974.840593:0:8299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782216974.840606:0:8299:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88e67a2d2200/0xf210a9075089ec28 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089ec21 expref: 19 pid: 5775 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216974.840621:0:8299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88e67a2d2200/0xf210a9075089ec28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf210a9075089ec21 expref: 19 pid: 5775 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216974.840643:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e67a2d2200/0xf210a9075089ec28 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf210a9075089ec21 expref: 19 pid: 5775 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216974.840664:0:8299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782216974.840761:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652483b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:526a4802-b871-4bcf-870f-067f11655366+18:3302:x1868789733972352:12345-0@lo:103:ldlm_bl.0 Request processed in 204us (3108us total) trans 0 rc 0/0 00010000:00010000:2.0:1782216974.840770:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: ffff88e67437ae00/0xf210a9075089ec13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089ec1a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216974.840771:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1782216974.840789:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782216974.840830:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e67437ae00/0xf210a9075089ec13 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089ec1a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216974.840839:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:526a4802-b871-4bcf-870f-067f11655366:3302:1868789733972352:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782216974.840843:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e67437ae00/0xf210a9075089ec13 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089ec1a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216974.840901:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216974.840904:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216974.840907:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216974.840917:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782216974.840936:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e646107800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733972480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782216974.841008:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216974.841295:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733972480 00000100:00100000:3.0:1782216974.841301:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733972480 00010000:00010000:3.0:1782216974.841334:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88e640031200/0xf210a9075089ec1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089ec13 expref: 18 pid: 5778 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216974.841369:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782216974.841377:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64479b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:526a4802-b871-4bcf-870f-067f11655366+18:3304:x1868789733972480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782216974.841387:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782216974.841401:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88e640031200/0xf210a9075089ec1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089ec13 expref: 18 pid: 5778 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216974.841411:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88e640031200/0xf210a9075089ec1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf210a9075089ec13 expref: 18 pid: 5778 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216974.841423:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e640031200/0xf210a9075089ec1a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf210a9075089ec13 expref: 18 pid: 5778 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216974.841434:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782216974.841491:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64479b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:526a4802-b871-4bcf-870f-067f11655366+17:3304:x1868789733972480:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216974.841497:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782216974.841693:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e646107800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733972480:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782216974.844964:0:11514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: ffff88e640031600/0xf210a9075089ec05 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089ec0c expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216974.844979:0:11514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782216974.845008:0:11514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e640031600/0xf210a9075089ec05 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089ec0c expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216974.845016:0:11514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e640031600/0xf210a9075089ec05 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089ec0c expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216974.845046:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216974.845048:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216974.845050:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782216974.845185:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733972608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782216974.845278:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216974.853741:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733972608 00000100:00100000:2.0:1782216974.853761:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733972608 00010000:00010000:2.0:1782216974.853819:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88e67a2d3000/0xf210a9075089ec0c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089ec05 expref: 17 pid: 5776 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216974.853901:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1782216974.853913:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652483100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:526a4802-b871-4bcf-870f-067f11655366+17:3304:x1868789733972608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782216974.853954:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782216974.853961:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88e67a2d3000/0xf210a9075089ec0c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089ec05 expref: 17 pid: 5776 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216974.853976:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88e67a2d3000/0xf210a9075089ec0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf210a9075089ec05 expref: 17 pid: 5776 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216974.853997:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e67a2d3000/0xf210a9075089ec0c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf210a9075089ec05 expref: 17 pid: 5776 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216974.854026:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88e640031400/0xf210a9075089ed6a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216974.854036:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e640031400/0xf210a9075089ed6a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216974.854059:0:5769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88e640031400/0xf210a9075089ed6a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216974.854068:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88e640031400/0xf210a9075089ed6a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216974.854075:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88e640031400/0xf210a9075089ed6a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216974.854081:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88e640031400/0xf210a9075089ed6a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216974.854088:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640031400 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:2.0:1782216974.854092:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88e640031400/0xf210a9075089ed6a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216974.854297:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88e640031400/0xf210a9075089ed6a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216974.854328:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88e640031400/0xf210a9075089ed6a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216974.854340:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782216974.854443:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652483100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:526a4802-b871-4bcf-870f-067f11655366+16:3304:x1868789733972608:12345-0@lo:103:ldlm_bl.0 Request processed in 532us (9164us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216974.854452:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782216974.854715:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733972608:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782216974.854827:0:11512:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88e640031400/0xf210a9075089ed6a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216974.854837:0:11512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88e640031400/0xf210a9075089ed6a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216974.854843:0:11512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e640031400/0xf210a9075089ed6a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216974.933019:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216975.956091:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216976.315031:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216976.315754:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714016128 00000100:00100000:3.0:1782216976.315763:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714016128 00000100:00100000:3.0:1782216976.315850:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 250 00000100:00100000:3.0:1782216976.315860:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e65774d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+11:5572:x1868789714016128:12345-192.168.203.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782216976.315903:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782216976.315922:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e640031400/0xf210a9075089ed71 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62025f expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216976.315963:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e640031400/0xf210a9075089ed71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62025f expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216976.315974:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e640031400/0xf210a9075089ed71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62025f expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216976.315983:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e640031400, rc 0) 00000100:00100000:3.0:1782216976.316037:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e65774d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+12:5572:x1868789714016128:12345-192.168.203.19@tcp:101:ll_cfg_requeue.0 Request processed in 179us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216976.316051:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 250 00000100:00100000:1.0:1782216976.318221:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216976.318295:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714016256 00000100:00100000:3.0:1782216976.318303:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714016256 00000100:00100000:3.0:1782216976.318346:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 251 00000100:00100000:3.0:1782216976.318355:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e65774f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+12:5572:x1868789714016256:12345-192.168.203.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782216976.318613:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e65774f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+12:5572:x1868789714016256:12345-192.168.203.19@tcp:501:ll_cfg_requeue.0 Request processed in 257us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216976.318621:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 251 00000100:00100000:1.0:1782216976.328806:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216976.328894:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714016384 00000100:00100000:3.0:1782216976.328903:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714016384 00000100:00100000:3.0:1782216976.328951:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 252 00000100:00100000:3.0:1782216976.328960:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e65774d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+12:5572:x1868789714016384:12345-192.168.203.19@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782216976.329167:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e65774d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+12:5572:x1868789714016384:12345-192.168.203.19@tcp:503:ll_cfg_requeue.0 Request processed in 207us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216976.329175:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 252 00000100:00100000:0.0:1782216976.346359:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216976.346502:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714016512 00000100:00100000:2.0:1782216976.346511:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714016512 00000100:00100000:2.0:1782216976.346558:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 253 00000100:00100000:2.0:1782216976.346567:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e65774c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+12:9953:x1868789714016512:12345-192.168.203.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782216976.346870:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e65774c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+12:9953:x1868789714016512:12345-192.168.203.19@tcp:502:llog_process_th.0 Request processed in 304us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216976.346904:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 253 00000100:00100000:2.0:1782216976.359789:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216976.359920:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714016640 00000100:00100000:1.0:1782216976.359933:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714016640 00000100:00100000:1.0:1782216976.360002:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 254 00000100:00100000:1.0:1782216976.360243:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e65774e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+12:9953:x1868789714016640:12345-192.168.203.19@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782216976.360638:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e65774e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+12:9953:x1868789714016640:12345-192.168.203.19@tcp:502:llog_process_th.0 Request processed in 620us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216976.360647:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 254 00000100:00100000:1.0:1782216976.386488:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216976.386746:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714016768 00000100:00100000:2.0:1782216976.386755:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714016768 00000100:00100000:2.0:1782216976.386801:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 255 00000100:00100000:2.0:1782216976.386811:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e65774f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+12:5572:x1868789714016768:12345-192.168.203.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782216976.386826:0:5775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216976.386842:0:5775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e6738af000/0xf210a9075089ed78 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620266 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216976.386905:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e6738af000/0xf210a9075089ed78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620266 expref: 13 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216976.386916:0:5775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e6738af000/0xf210a9075089ed78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620266 expref: 13 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216976.386925:0:5775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738af000, rc 0) 00000100:00100000:2.0:1782216976.387187:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e65774f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:5572:x1868789714016768:12345-192.168.203.19@tcp:101:ll_cfg_requeue.0 Request processed in 377us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216976.387195:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 255 00000100:00100000:0.0:1782216976.397580:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216976.402609:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714016896 00000100:00100000:1.0:1782216976.402624:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714016896 00000100:00100000:1.0:1782216976.402811:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 256 00000100:00100000:1.0:1782216976.402836:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e68044f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:5572:x1868789714016896:12345-192.168.203.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782216976.403167:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e68044f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:5572:x1868789714016896:12345-192.168.203.19@tcp:501:ll_cfg_requeue.0 Request processed in 332us (5594us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216976.403175:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 256 00000100:00100000:1.0:1782216976.411071:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216976.412353:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714017024 00000100:00100000:3.0:1782216976.412378:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714017024 00000100:00100000:3.0:1782216976.412491:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 257 00000100:00100000:3.0:1782216976.412501:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e68044d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:5572:x1868789714017024:12345-192.168.203.19@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782216976.412720:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e68044d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:5572:x1868789714017024:12345-192.168.203.19@tcp:503:ll_cfg_requeue.0 Request processed in 220us (1658us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216976.412728:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 257 00000100:00100000:1.0:1782216976.419375:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216976.419648:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714017152 00000100:00100000:3.0:1782216976.419657:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714017152 00000100:00100000:3.0:1782216976.419709:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 258 00000100:00100000:3.0:1782216976.419719:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e68044c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:9956:x1868789714017152:12345-192.168.203.19@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782216976.419978:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e68044c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:9956:x1868789714017152:12345-192.168.203.19@tcp:502:llog_process_th.0 Request processed in 259us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216976.419985:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 258 00000100:00100000:0.0:1782216976.422309:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216976.422436:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714017280 00000100:00100000:3.0:1782216976.422443:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714017280 00000100:00100000:3.0:1782216976.422495:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 259 00000100:00100000:3.0:1782216976.422504:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e68044e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:9956:x1868789714017280:12345-192.168.203.19@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782216976.422729:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e68044e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:9956:x1868789714017280:12345-192.168.203.19@tcp:502:llog_process_th.0 Request processed in 225us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216976.422738:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 259 10000000:01000000:0.0:1782216976.787982:0:5780:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782216976.787988:0:5780:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff88e64853e800 from 7 10000000:01000000:0.0:1782216976.787993:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782216976.788039:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67437a400/0xf210a9075089ed7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216976.788050:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e67437a400/0xf210a9075089ed7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216976.788070:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e67437a400/0xf210a9075089ed7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216976.788095:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a815500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733972736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782216976.788157:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216976.788280:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e650459d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782216976.790365:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733972736 00000100:00100000:2.0:1782216976.790375:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733972736 00000100:00100000:2.0:1782216976.790490:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1782216976.790500:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e68044f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+16:5780:x1868789733972736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782216976.790515:0:5775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216976.790529:0:5775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e6738afc00/0xf210a9075089ed86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089ed7f expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216976.790553:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e6738afc00/0xf210a9075089ed86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089ed7f expref: 17 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216976.790564:0:5775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e6738afc00/0xf210a9075089ed86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089ed7f expref: 17 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216976.790590:0:5775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738afc00, rc 0) 00000100:00100000:2.0:1782216976.790653:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e68044f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+17:5780:x1868789733972736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (2495us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216976.790674:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1782216976.790761:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a815500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733972736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782216976.790777:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e67437a400/0xf210a9075089ed7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ed86 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216976.790786:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e67437a400/0xf210a9075089ed7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089ed86 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216976.790846:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a815500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733972864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782216976.790913:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216976.797654:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e650459d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782216976.799360:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733972864 00000100:00100000:3.0:1782216976.799374:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733972864 00000100:00100000:3.0:1782216976.799428:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1782216976.799437:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e68044f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+17:5780:x1868789733972864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782216976.800047:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e68044f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+17:5780:x1868789733972864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 609us (9132us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216976.800134:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1782216976.800235:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a815500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733972864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782216976.800298:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a815500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733972992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782216976.800341:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216976.800372:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e650459d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782216976.805364:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733972992 00000100:00100000:1.0:1782216976.805378:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733972992 00000100:00100000:1.0:1782216976.805468:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1782216976.805478:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e68044d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+17:5780:x1868789733972992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782216976.805720:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e68044d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+17:5780:x1868789733972992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 242us (5378us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216976.805728:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1782216976.806219:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a815500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733972992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782216976.808003:0:11527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a815500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:11527:1868789733973120:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782216976.808133:0:11527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216976.808163:0:11527:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6504590c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782216976.810187:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733973120 00000100:00100000:1.0:1782216976.810201:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733973120 00000100:00100000:1.0:1782216976.810264:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1782216976.810273:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e68044cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+17:11527:x1868789733973120:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782216976.810519:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e68044cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+17:11527:x1868789733973120:12345-0@lo:502:llog_process_th.0 Request processed in 247us (2387us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216976.810527:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1782216976.811601:0:11527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a815500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:11527:1868789733973120:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782216976.811638:0:11527:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782216976.811648:0:11527:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782216976.811651:0:11527:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1782216976.811658:0:11527:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88e64853e800 00000020:00000080:0.0:1782216976.811661:0:11527:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1782216976.811753:0:11527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a815500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:11527:1868789733973248:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782216976.811809:0:11527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216976.811846:0:11527:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6504590c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782216976.812004:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733973248 00000100:00100000:2.0:1782216976.812011:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733973248 00000100:00100000:2.0:1782216976.812054:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1782216976.812072:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e68044c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+17:11527:x1868789733973248:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782216976.812234:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e68044c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+17:11527:x1868789733973248:12345-0@lo:502:llog_process_th.0 Request processed in 162us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216976.812242:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1782216976.812996:0:11527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a815500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:11527:1868789733973248:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782216976.813022:0:11527:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782216976.813028:0:11527:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782216976.813029:0:11527:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1782216976.813034:0:11527:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1782216976.813297:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1782216976.813317:0:5780:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782216976.813327:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67437a400/0xf210a9075089ed7f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ed86 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216976.813337:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e67437a400/0xf210a9075089ed7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ed86 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216976.813347:0:5780:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782216976.813350:0:5780:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff88e673f4d000 from 7 10000000:01000000:2.0:1782216976.813352:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782216976.813381:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e6738ae000/0xf210a9075089ed8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216976.813388:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e6738ae000/0xf210a9075089ed8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216976.813395:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e6738ae000/0xf210a9075089ed8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216976.813410:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e646106d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733973376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782216976.813533:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216976.813577:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6447df9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782216976.813639:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733973376 00000100:00100000:3.0:1782216976.813645:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733973376 00000100:00100000:3.0:1782216976.813687:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1782216976.813695:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+17:5780:x1868789733973376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782216976.813706:0:5775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782216976.813718:0:5775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e640031200/0xf210a9075089ed94 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089ed8d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216976.813739:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e640031200/0xf210a9075089ed94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089ed8d expref: 18 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216976.813749:0:5775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e640031200/0xf210a9075089ed94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089ed8d expref: 18 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216976.813757:0:5775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e640031200, rc 0) 00000100:00100000:3.0:1782216976.813799:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+18:5780:x1868789733973376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216976.813805:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1782216976.817093:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e646106d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733973376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782216976.817121:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e6738ae000/0xf210a9075089ed8d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ed94 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216976.817133:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e6738ae000/0xf210a9075089ed8d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089ed94 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216976.817205:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a815500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733973504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782216976.817259:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216976.817291:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6504590c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782216976.817481:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733973504 00000100:00100000:2.0:1782216976.817487:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733973504 00000100:00100000:2.0:1782216976.817531:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1782216976.817540:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+18:5780:x1868789733973504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782216976.817797:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+18:5780:x1868789733973504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 257us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216976.817804:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1782216976.818256:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a815500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733973504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782216976.818288:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a815500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733973632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782216976.818326:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216976.818344:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6504590c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782216976.820846:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733973632 00000100:00100000:2.0:1782216976.820859:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733973632 00000100:00100000:2.0:1782216976.820945:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1782216976.820954:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+18:5780:x1868789733973632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782216976.821709:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+18:5780:x1868789733973632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 753us (3380us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216976.821718:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1782216976.821823:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a815500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733973632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782216976.822315:0:11528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a815500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:11528:1868789733973760:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782216976.822359:0:11528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216976.822393:0:11528:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6504596c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782216976.822443:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733973760 00000100:00100000:3.0:1782216976.822448:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733973760 00000100:00100000:3.0:1782216976.822492:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1782216976.822499:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+18:11528:x1868789733973760:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782216976.822644:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+18:11528:x1868789733973760:12345-0@lo:502:llog_process_th.0 Request processed in 144us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216976.822656:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1782216976.822778:0:11528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a815500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:11528:1868789733973760:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782216976.822799:0:11528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782216976.822808:0:11528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782216976.822810:0:11528:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1782216976.822818:0:11528:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88e673f4d000 00000020:00000080:0.0:1782216976.822820:0:11528:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1782216976.822910:0:11528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a815500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:11528:1868789733973888:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782216976.822942:0:11528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216976.822957:0:11528:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6504596c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782216976.823146:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733973888 00000100:00100000:3.0:1782216976.823151:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733973888 00000100:00100000:3.0:1782216976.823181:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1782216976.823188:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+18:11528:x1868789733973888:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782216976.823298:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+18:11528:x1868789733973888:12345-0@lo:502:llog_process_th.0 Request processed in 110us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216976.823304:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1782216976.825350:0:11528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a815500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:11528:1868789733973888:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782216976.830416:0:11528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782216976.830431:0:11528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782216976.830433:0:11528:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1782216976.830439:0:11528:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1782216976.832165:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1782216976.832194:0:5780:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782216976.832205:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e6738ae000/0xf210a9075089ed8d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ed94 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216976.832217:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e6738ae000/0xf210a9075089ed8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ed94 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216976.832229:0:5780:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782216976.832232:0:5780:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff88e650a2a800 from 7 10000000:01000000:2.0:1782216976.832235:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782216976.832272:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e6738af800/0xf210a9075089ed9b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216976.832280:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e6738af800/0xf210a9075089ed9b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216976.832308:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e6738af800/0xf210a9075089ed9b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216976.832334:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e646107100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733974016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782216976.832396:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216976.832434:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6447dfc00 going to sleep for 11 seconds 00000100:00100000:0.0:1782216976.836319:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733974016 00000100:00100000:0.0:1782216976.836332:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733974016 00000100:00100000:0.0:1782216976.836389:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1782216976.836399:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+18:5780:x1868789733974016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782216976.836416:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216976.836432:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e67437b600/0xf210a9075089eda2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089ed9b expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216976.836470:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e67437b600/0xf210a9075089eda2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089ed9b expref: 19 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216976.836482:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e67437b600/0xf210a9075089eda2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089ed9b expref: 19 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216976.836491:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437b600, rc 0) 00000100:00100000:0.0:1782216976.836575:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+19:5780:x1868789733974016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (4178us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216976.836591:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1782216976.836657:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e646107100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733974016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782216976.836674:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e6738af800/0xf210a9075089ed9b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089eda2 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216976.836682:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e6738af800/0xf210a9075089ed9b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089eda2 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216976.836749:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a815500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733974144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782216976.836779:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216976.836803:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e650459300 going to sleep for 11 seconds 00000100:00100000:0.0:1782216976.836816:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733974144 00000100:00100000:0.0:1782216976.836820:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733974144 00000100:00100000:0.0:1782216976.836842:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1782216976.836849:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+19:5780:x1868789733974144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782216976.837347:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+19:5780:x1868789733974144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 497us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216976.837355:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1782216976.837425:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a815500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733974144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782216976.837466:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e646105f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733974272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782216976.837505:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216976.837533:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6447dfb40 going to sleep for 11 seconds 00000100:00100000:0.0:1782216976.837746:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733974272 00000100:00100000:0.0:1782216976.837751:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733974272 00000100:00100000:0.0:1782216976.837786:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1782216976.837793:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+19:5780:x1868789733974272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782216976.837950:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+19:5780:x1868789733974272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216976.837956:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1782216976.838091:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e646105f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:526a4802-b871-4bcf-870f-067f11655366:5780:1868789733974272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782216976.838446:0:11530:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e646105f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:11530:1868789733974400:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782216976.838489:0:11530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216976.838514:0:11530:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6447dfe40 going to sleep for 11 seconds 00000100:00100000:0.0:1782216976.839047:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733974400 00000100:00100000:0.0:1782216976.839052:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733974400 00000100:00100000:0.0:1782216976.839091:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1782216976.839098:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+19:11530:x1868789733974400:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782216976.839242:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+19:11530:x1868789733974400:12345-0@lo:502:llog_process_th.0 Request processed in 144us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216976.839250:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1782216976.839378:0:11530:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e646105f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:11530:1868789733974400:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782216976.839402:0:11530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782216976.839411:0:11530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782216976.839413:0:11530:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1782216976.839420:0:11530:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88e650a2a800 00000020:00000080:2.0:1782216976.839423:0:11530:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1782216976.839495:0:11530:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e646105f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:11530:1868789733974528:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782216976.839529:0:11530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216976.839551:0:11530:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6447dfe40 going to sleep for 11 seconds 00000100:00100000:0.0:1782216976.839689:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733974528 00000100:00100000:0.0:1782216976.839693:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733974528 00000100:00100000:0.0:1782216976.839724:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1782216976.839731:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+19:11530:x1868789733974528:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782216976.839840:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+19:11530:x1868789733974528:12345-0@lo:502:llog_process_th.0 Request processed in 108us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216976.839847:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1782216976.840005:0:11530:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e646105f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:526a4802-b871-4bcf-870f-067f11655366:11530:1868789733974528:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782216976.840030:0:11530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782216976.840034:0:11530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782216976.840036:0:11530:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1782216976.840039:0:11530:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1782216976.840238:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1782216976.840256:0:5780:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782216976.840266:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e6738af800/0xf210a9075089ed9b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089eda2 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216976.840276:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e6738af800/0xf210a9075089ed9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089eda2 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782216976.864490:0:11532:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1782216976.980046:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216977.364297:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782216977.364319:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e646105f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733974656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782216977.364381:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216977.364904:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733974656 00000100:00100000:0.0:1782216977.364912:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733974656 00000100:00100000:0.0:1782216977.364969:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1782216977.364978:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a807b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733974656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782216977.365012:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782216977.365084:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a807b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733974656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216977.365092:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1782216977.365195:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782216977.365350:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e646105f80 x1868789733974656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216993 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216977.365369:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e646105f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733974656:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1782216977.876797:0:11532:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1782216978.004440:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782216978.427816:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216978.427866:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216978.427951:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216978.427979:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216978.428015:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714017664 00000100:00100000:1.0:1782216978.428024:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714017664 00000100:00100000:1.0:1782216978.428092:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 60 00000100:00100000:1.0:1782216978.428102:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2359:x1868789714017664:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:1.0:1782216978.428173:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2359:x1868789714017664:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 71us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216978.428179:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 60 00000100:00080000:1.0:1782216978.428205:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782216978.428284:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714017408 00000100:00100000:0.0:1782216978.428288:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714017408 00000100:00100000:0.0:1782216978.428323:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 275 00000100:00100000:0.0:1782216978.428330:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2359:x1868789714017408:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:0.0:1782216978.428357:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2359:x1868789714017408:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 27us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216978.428363:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 275 00000100:00100000:2.0:1782216978.428777:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714017536 00000100:00100000:2.0:1782216978.428783:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714017536 00000100:00100000:2.0:1782216978.428843:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714017792 00000100:00100000:2.0:1782216978.428848:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714017792 00000100:00100000:3.0:1782216978.428852:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 104 00000100:00100000:3.0:1782216978.428865:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2359:x1868789714017536:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:2.0:1782216978.428902:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 105 00000100:00100000:2.0:1782216978.428912:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2359:x1868789714017792:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:3.0:1782216978.428927:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2359:x1868789714017536:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 65us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216978.428935:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 104 00000100:00100000:2.0:1782216978.428952:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2359:x1868789714017792:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 41us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216978.428962:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 105 00000100:00080000:1.0:1782216978.429475:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782216979.029503:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782216979.417129:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782216979.417153:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:526a4802-b871-4bcf-870f-067f11655366:3301:1868789733974784:0@lo:400:kworker.0 00000100:00100000:1.0:1782216979.417216:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216979.417276:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733974784 00000100:00100000:1.0:1782216979.417283:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733974784 00000100:00100000:1.0:1782216979.417322:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1782216979.417329:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+19:3301:x1868789733974784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216979.417389:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+19:3301:x1868789733974784:12345-0@lo:400:kworker.0 Request processed in 60us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216979.417396:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1782216979.418448:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:526a4802-b871-4bcf-870f-067f11655366:3301:1868789733974784:0@lo:400:kworker.0 00000100:00100000:0.0:1782216979.421376:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782216979.424516:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733975424:0@lo:400:kworker.0 00000100:00100000:1.0:1782216979.425758:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1868789733975168:0@lo:400:kworker.0 00000100:00100000:1.0:1782216979.425812:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216979.425850:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782216979.425901:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a806a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1868789733975296:0@lo:400:kworker.0 00000100:00100000:1.0:1782216979.425929:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216979.425968:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733975168 00000100:00100000:1.0:1782216979.425974:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733975168 00000100:00100000:1.0:1782216979.426019:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733975296 00000100:00100000:1.0:1782216979.426022:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733975296 00000100:00100000:1.0:1782216979.426043:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1782216979.426051:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1868789733975168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216979.426109:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1868789733975168:12345-0@lo:400:kworker.0 Request processed in 58us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216979.426117:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1782216979.426134:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1782216979.426140:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1868789733975296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216979.426164:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1868789733975296:12345-0@lo:400:kworker.0 Request processed in 25us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216979.426169:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:1.0:1782216979.426184:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782216979.426208:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a806a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1868789733975296:0@lo:400:kworker.0 00000100:00100000:1.0:1782216979.426217:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1868789733975168:0@lo:400:kworker.0 00000100:00100000:3.0:1782216979.428105:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216979.428162:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782216979.428174:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a804700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733975040:0@lo:400:kworker.0 00000100:00100000:3.0:1782216979.428217:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216979.428256:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733975424 00000100:00100000:3.0:1782216979.428262:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733975424 00000100:00100000:3.0:1782216979.428318:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733975040 00000100:00100000:3.0:1782216979.428321:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733975040 00000100:00100000:3.0:1782216979.428358:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782216979.428365:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a805f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1868789733975424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216979.428413:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a805f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1868789733975424:12345-0@lo:400:kworker.0 Request processed in 49us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216979.428420:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782216979.428440:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782216979.428446:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a805c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733975040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216979.428472:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a805c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733975040:12345-0@lo:400:kworker.0 Request processed in 27us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216979.428478:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:3.0:1782216979.428508:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67a804700 x1868789733975040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216979.428521:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a804700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733975040:0@lo:400:kworker.0 00000100:00100000:3.0:1782216979.428534:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733975424:0@lo:400:kworker.0 00000100:00080000:3.0:1782216979.429024:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782216979.429029:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782216979.430578:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868789733974912:0@lo:400:kworker.0 00000100:00100000:1.0:1782216979.432839:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216979.434761:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733974912 00000100:00100000:2.0:1782216979.434773:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733974912 00000100:00100000:2.0:1782216979.434825:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1782216979.434833:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868789733974912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216979.434954:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868789733974912:12345-0@lo:400:kworker.0 Request processed in 121us (2119us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216979.434962:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1782216979.435010:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868789733974912:0@lo:400:kworker.0 00000001:00080000:1.0:1782216979.517420:0:7488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:2.0:1782216979.925903:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733975552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782216979.925973:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216979.926334:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733975552 00000100:00100000:1.0:1782216979.926342:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733975552 00000100:00100000:1.0:1782216979.926387:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1782216979.926397:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e646104a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733975552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782216979.926458:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782216979.926515:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e646104a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733975552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216979.926523:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1782216979.927539:0:3304:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1782216979.927548:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88e67a1e5f80, transno 4294967300 00000100:00100000:2.0:1782216979.927595:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733975552:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782216980.053594:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216981.076139:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216982.100182:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782216982.484261:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e646104380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733975680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782216982.484334:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216982.484484:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733975680 00000100:00100000:0.0:1782216982.484492:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733975680 00000100:00100000:0.0:1782216982.484558:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1782216982.484569:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733975680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782216982.484614:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782216982.484773:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733975680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 205us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216982.484780:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1782216982.484817:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782216982.484864:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e646104380 x1868789733975680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216998 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216982.484902:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e646104380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733975680:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782216983.126339:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216983.549284:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216983.549418:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216983.549585:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782216983.549695:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714018176 00000100:00100000:0.0:1782216983.549707:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714018176 00000100:00100000:0.0:1782216983.549793:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 63 00000100:00100000:0.0:1782216983.549806:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e646105180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2359:x1868789714018176:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:0.0:1782216983.549942:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e646105180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2359:x1868789714018176:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 138us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216983.549968:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 63 00000100:00080000:2.0:1782216983.550253:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782216983.550297:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714018048 00000100:00100000:1.0:1782216983.550303:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714018048 00000100:00100000:1.0:1782216983.550390:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714018304 00000100:00100000:1.0:1782216983.550394:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714018304 00000100:00100000:3.0:1782216983.550480:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 109 00000100:00100000:3.0:1782216983.550493:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e646106a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2359:x1868789714018048:12345-192.168.203.19@tcp:400:kworker.0 00000100:00080000:2.0:1782216983.550512:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782216983.550642:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 110 00000100:00100000:1.0:1782216983.550651:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e646105500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2359:x1868789714018304:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:1.0:1782216983.550696:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e646105500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2359:x1868789714018304:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 47us (1289us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216983.550703:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 110 00000100:00100000:3.0:1782216983.550867:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e646106a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2359:x1868789714018048:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 377us (1596us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216983.550900:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 109 00000100:00100000:0.0:1782216983.552530:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216983.552632:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714017920 00000100:00100000:1.0:1782216983.552641:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714017920 00000100:00100000:1.0:1782216983.552699:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 277 00000100:00100000:1.0:1782216983.552709:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2358:x1868789714017920:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:1.0:1782216983.552790:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2358:x1868789714017920:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 83us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216983.552819:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 277 00010000:00010000:3.0:1782216984.150838:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782216984.535715:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1868789733976192:0@lo:400:kworker.0 00000100:00100000:0.0:1782216984.535790:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868789733975936:0@lo:400:kworker.0 00000100:00100000:1.0:1782216984.535791:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216984.535874:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216984.535904:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782216984.535920:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:526a4802-b871-4bcf-870f-067f11655366:3301:1868789733975808:0@lo:400:kworker.0 00000100:00100000:0.0:1782216984.535957:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733976448:0@lo:400:kworker.0 00000100:00100000:1.0:1782216984.535970:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216984.536023:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1868789733976320:0@lo:400:kworker.0 00000100:00100000:1.0:1782216984.536060:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216984.536095:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216984.536121:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733975808 00000100:00100000:1.0:1782216984.536130:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733975808 00000100:00100000:0.0:1782216984.536149:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782216984.536163:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733976064:0@lo:400:kworker.0 00000100:00100000:1.0:1782216984.536191:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1782216984.536213:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+19:3301:x1868789733975808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216984.536219:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216984.536293:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733976192 00000100:00100000:0.0:1782216984.536302:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733976192 00000100:00100000:1.0:1782216984.536309:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+19:3301:x1868789733975808:12345-0@lo:400:kworker.0 Request processed in 103us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216984.536322:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1782216984.536389:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733975936 00000100:00100000:0.0:1782216984.536394:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733975936 00000100:00100000:0.0:1782216984.536429:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733976320 00000100:00100000:0.0:1782216984.536432:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733976320 00000100:00100000:0.0:1782216984.536476:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1782216984.536493:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1868789733976192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216984.536496:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1782216984.536517:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868789733975936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216984.536577:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1868789733976192:12345-0@lo:400:kworker.0 Request processed in 91us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216984.536586:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1782216984.536695:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868789733975936:12345-0@lo:400:kworker.0 Request processed in 183us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216984.536703:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1782216984.536720:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1782216984.536726:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1868789733976320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216984.536754:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1868789733976320:12345-0@lo:400:kworker.0 Request processed in 29us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216984.536777:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1782216984.536809:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:526a4802-b871-4bcf-870f-067f11655366:3301:1868789733975808:0@lo:400:kworker.0 00000100:00100000:1.0:1782216984.536822:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1868789733976320:0@lo:400:kworker.0 00000100:00100000:1.0:1782216984.536832:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1868789733976192:0@lo:400:kworker.0 00000100:00100000:3.0:1782216984.542561:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733976448 00000100:00100000:3.0:1782216984.542592:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733976448 00000100:00100000:3.0:1782216984.542659:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733976064 00000100:00100000:3.0:1782216984.542663:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733976064 00000100:00100000:3.0:1782216984.542691:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1782216984.542701:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a814e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733976448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216984.542788:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a814e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733976448:12345-0@lo:400:kworker.0 Request processed in 89us (6700us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216984.542795:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1782216984.542811:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1782216984.542817:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a816680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733976064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216984.542845:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a816680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733976064:12345-0@lo:400:kworker.0 Request processed in 29us (6641us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216984.542851:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1782216984.552781:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782216984.552794:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782216984.552799:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1782216984.552874:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e648b95880 x1868789733976064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782217000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216984.552912:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733976064:0@lo:400:kworker.0 00000100:00100000:0.0:1782216984.552959:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868789733975936:0@lo:400:kworker.0 00000100:00100000:0.0:1782216984.553687:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733976448:0@lo:400:kworker.0 00000100:00100000:2.0:1782216985.046344:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a804700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733976576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782216985.046438:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216985.046786:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733976576 00000100:00100000:1.0:1782216985.046796:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733976576 00000100:00100000:1.0:1782216985.046931:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1782216985.046943:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e646106680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733976576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782216985.046992:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782216985.047064:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e646106680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733976576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216985.047072:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1782216985.047164:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a804700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733976576:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782216985.172447:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216986.197250:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782216987.096493:0:11532:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1782216987.220174:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216987.604423:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782216987.606138:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733976704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782216987.606278:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216987.606376:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733976704 00000100:00100000:0.0:1782216987.606392:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733976704 00000100:00080000:2.0:1782216987.606463:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782216987.606471:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782216987.606483:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733976704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782216987.606531:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782216987.607745:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733976704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1260us (1463us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216987.607755:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1782216987.611163:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e648b96680 x1868789733976704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782217003 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216987.611191:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733976704:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782216988.244337:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216988.677909:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216988.677955:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216988.677990:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216988.678020:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216988.678240:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714018560 00000100:00100000:1.0:1782216988.678258:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714018560 00000100:00100000:1.0:1782216988.678316:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714018816 00000100:00100000:1.0:1782216988.678320:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714018816 00000100:00100000:1.0:1782216988.678342:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 114 00000100:00100000:1.0:1782216988.678352:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e646106300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2357:x1868789714018560:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:1.0:1782216988.678428:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e646106300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2357:x1868789714018560:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 76us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216988.678435:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 114 00000100:00100000:1.0:1782216988.678453:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 115 00000100:00100000:1.0:1782216988.678459:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e646104380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2357:x1868789714018816:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:1.0:1782216988.678513:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e646104380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2357:x1868789714018816:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 53us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216988.678521:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 115 00000100:00080000:2.0:1782216988.678653:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782216988.678728:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714018432 00000100:00100000:0.0:1782216988.678733:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714018432 00000100:00100000:0.0:1782216988.678767:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 279 00000100:00100000:0.0:1782216988.678774:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2357:x1868789714018432:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:0.0:1782216988.678801:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2357:x1868789714018432:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 29us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216988.678807:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 279 00000100:00100000:3.0:1782216988.679411:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714018688 00000100:00100000:3.0:1782216988.679418:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714018688 00000100:00100000:3.0:1782216988.679470:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 66 00000100:00100000:3.0:1782216988.679478:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e646105f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2357:x1868789714018688:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:3.0:1782216988.679537:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e646105f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2357:x1868789714018688:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 59us (1515us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216988.679544:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 66 00000100:00080000:2.0:1782216988.679703:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1782216989.268158:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782216989.653678:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1868789733977216:0@lo:400:kworker.0 00000100:00100000:1.0:1782216989.653744:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216989.653800:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782216989.653807:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:526a4802-b871-4bcf-870f-067f11655366:3301:1868789733976832:0@lo:400:kworker.0 00000100:00100000:1.0:1782216989.653846:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216989.653868:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1868789733977344:0@lo:400:kworker.0 00000100:00100000:1.0:1782216989.653928:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216989.653958:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868789733976960:0@lo:400:kworker.0 00000100:00100000:1.0:1782216989.653981:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216989.654211:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733977088:0@lo:400:kworker.0 00000100:00100000:3.0:1782216989.654243:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216989.654293:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733977088 00000100:00100000:3.0:1782216989.654300:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733977088 00000100:00100000:3.0:1782216989.654353:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782216989.654362:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733977088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216989.654412:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733977088:12345-0@lo:400:kworker.0 Request processed in 51us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216989.654419:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1782216989.654450:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782216989.654475:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e648b96680 x1868789733977088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782217005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216989.654487:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733977088:0@lo:400:kworker.0 00000100:00100000:3.0:1782216989.654549:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733976832 00000100:00100000:3.0:1782216989.654553:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733976832 00000100:00100000:3.0:1782216989.654577:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1782216989.654582:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+19:3301:x1868789733976832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216989.654617:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+19:3301:x1868789733976832:12345-0@lo:400:kworker.0 Request processed in 34us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216989.654623:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1782216989.654758:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:526a4802-b871-4bcf-870f-067f11655366:3301:1868789733976832:0@lo:400:kworker.0 00000100:00100000:1.0:1782216989.654869:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733977472:0@lo:400:kworker.0 00000100:00100000:1.0:1782216989.654913:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216989.656839:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733977216 00000100:00100000:3.0:1782216989.656850:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733977216 00000100:00100000:3.0:1782216989.656926:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733977344 00000100:00100000:3.0:1782216989.656930:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733977344 00000100:00100000:3.0:1782216989.656945:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733976960 00000100:00100000:3.0:1782216989.656948:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733976960 00000100:00100000:3.0:1782216989.656963:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1782216989.656971:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1868789733977216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216989.657248:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1868789733977216:12345-0@lo:400:kworker.0 Request processed in 277us (3502us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216989.657255:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1782216989.657270:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1782216989.657277:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f7a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1868789733977344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216989.657306:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f7a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1868789733977344:12345-0@lo:400:kworker.0 Request processed in 30us (3378us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216989.657312:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1782216989.657323:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1782216989.657329:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f7a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868789733976960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216989.657362:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f7a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868789733976960:12345-0@lo:400:kworker.0 Request processed in 34us (3381us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216989.657368:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:3.0:1782216989.657741:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782216989.657800:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1868789733977344:0@lo:400:kworker.0 00000100:00100000:3.0:1782216989.657814:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1868789733977216:0@lo:400:kworker.0 00000100:00100000:3.0:1782216989.657867:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733977472 00000100:00100000:3.0:1782216989.657870:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733977472 00000100:00100000:3.0:1782216989.657929:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1782216989.657936:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f7a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733977472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216989.657983:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f7a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733977472:12345-0@lo:400:kworker.0 Request processed in 48us (3069us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216989.657991:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1782216989.658006:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782216989.658773:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868789733976960:0@lo:400:kworker.0 00000100:00100000:3.0:1782216989.658787:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733977472:0@lo:400:kworker.0 00000100:00100000:1.0:1782216990.164336:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733977600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782216990.164405:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216990.164962:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733977600 00000100:00100000:3.0:1782216990.164970:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733977600 00000100:00100000:3.0:1782216990.165023:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1782216990.165033:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f7a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733977600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782216990.165068:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782216990.165117:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f7a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733977600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216990.165123:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1782216990.165178:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733977600:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782216990.295991:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216991.316635:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216992.340697:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216992.725083:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f7a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733977728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782216992.725170:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216992.725306:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733977728 00000100:00100000:1.0:1782216992.725314:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733977728 00000100:00100000:1.0:1782216992.725375:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782216992.725385:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733977728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782216992.725419:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782216992.725479:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733977728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216992.725487:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1782216992.725537:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67f7a1180 x1868789733977728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782217008 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216992.725556:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f7a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733977728:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782216992.725704:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782216993.364175:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216993.793420:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782216993.793472:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216993.793539:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714018944 00000100:00100000:1.0:1782216993.793549:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714018944 00000100:00100000:1.0:1782216993.793604:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 281 00000100:00100000:1.0:1782216993.793614:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2358:x1868789714018944:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:1.0:1782216993.793688:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2358:x1868789714018944:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 75us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216993.793696:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 281 00000100:00100000:3.0:1782216993.793770:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714019072 00000100:00100000:3.0:1782216993.793774:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714019072 00000100:00100000:3.0:1782216993.793822:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 119 00000100:00100000:3.0:1782216993.793830:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e646107100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2358:x1868789714019072:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:3.0:1782216993.793861:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e646107100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2358:x1868789714019072:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 32us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216993.793915:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 119 00000100:00080000:1.0:1782216993.794149:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782216993.802308:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216993.802366:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782216993.802497:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714019200 00000100:00100000:0.0:1782216993.802509:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714019200 00000100:00100000:0.0:1782216993.802595:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 20 00000100:00100000:0.0:1782216993.802606:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a806a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2355:x1868789714019200:12345-192.168.203.19@tcp:9:kworker.0 00000020:00000080:0.0:1782216993.802645:0:7991:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf210a9075089ecde 00000100:00080000:0.0:1782216993.802672:0:7991:0:(import.c:65:import_set_state_nolock()) ffff88e67a471000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782216993.802720:0:7991:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1782216993.803087:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a806a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+2:2355:x1868789714019200:12345-192.168.203.19@tcp:9:kworker.0 Request processed in 481us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216993.803097:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 20 00010000:00010000:0.0:1782216993.803121:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782216993.803348:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714019328 00000100:00100000:1.0:1782216993.803354:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714019328 00000100:00100000:1.0:1782216993.803402:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 120 00000100:00100000:1.0:1782216993.803411:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2359:x1868789714019328:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:1.0:1782216993.803456:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2359:x1868789714019328:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 47us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216993.803474:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 120 00000100:00080000:3.0:1782216993.803581:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782216993.803586:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1782216994.388100:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216994.772649:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f7a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:526a4802-b871-4bcf-870f-067f11655366:3302:1868789733977856:0@lo:400:kworker.0 00000100:00100000:1.0:1782216994.772673:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f7a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868789733977984:0@lo:400:kworker.0 00000100:00100000:0.0:1782216994.772915:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f7a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733978112:0@lo:400:kworker.0 00000100:00100000:2.0:1782216994.776542:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f7a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1868789733978240:0@lo:400:kworker.0 00000100:00100000:3.0:1782216994.780019:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216994.781984:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733977856 00000100:00100000:3.0:1782216994.782000:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733977856 00000100:00100000:3.0:1782216994.782069:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1782216994.782081:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+19:3302:x1868789733977856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216994.782439:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+19:3302:x1868789733977856:12345-0@lo:400:kworker.0 Request processed in 359us (2431us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216994.782448:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1782216994.782645:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f7a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:526a4802-b871-4bcf-870f-067f11655366:3302:1868789733977856:0@lo:400:kworker.0 00000100:00100000:3.0:1782216994.782678:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f7a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1868789733978368:0@lo:400:kworker.0 00000100:00100000:3.0:1782216994.782717:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216994.782809:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733978368 00000100:00100000:3.0:1782216994.782814:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733978368 00000100:00100000:3.0:1782216994.782851:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1782216994.782858:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1868789733978368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216994.782918:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1868789733978368:12345-0@lo:400:kworker.0 Request processed in 61us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216994.782924:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:3.0:1782216994.782944:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782216994.782981:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f7a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1868789733978368:0@lo:400:kworker.0 00000100:00100000:1.0:1782216994.785894:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216994.786026:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733977984 00000100:00100000:1.0:1782216994.786036:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733977984 00000100:00100000:1.0:1782216994.786093:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1782216994.786116:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f7a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868789733977984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216994.786178:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f7a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868789733977984:12345-0@lo:400:kworker.0 Request processed in 65us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216994.786193:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1782216994.786567:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f7a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868789733977984:0@lo:400:kworker.0 00000100:00100000:1.0:1782216994.786583:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f7a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733978496:0@lo:400:kworker.0 00000100:00100000:1.0:1782216994.786621:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216994.786676:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733978496 00000100:00100000:1.0:1782216994.786681:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733978496 00000100:00100000:1.0:1782216994.786727:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1782216994.786735:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f7a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733978496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216994.786771:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f7a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733978496:12345-0@lo:400:kworker.0 Request processed in 38us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216994.786778:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1782216994.786799:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782216994.786819:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f7a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733978496:0@lo:400:kworker.0 00000100:00100000:1.0:1782216994.786872:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216994.786954:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733978112 00000100:00100000:1.0:1782216994.786958:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733978112 00000100:00100000:1.0:1782216994.786992:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1782216994.786998:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f7a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733978112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216994.787031:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f7a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733978112:12345-0@lo:400:kworker.0 Request processed in 34us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216994.787038:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1782216994.787050:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782216994.787071:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67f7a2300 x1868789733978112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782217010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216994.787082:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f7a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733978112:0@lo:400:kworker.0 00000100:00100000:2.0:1782216994.788936:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216994.788994:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733978240 00000100:00100000:2.0:1782216994.789003:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733978240 00000100:00100000:2.0:1782216994.789214:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1782216994.789226:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e646106d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1868789733978240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216994.789312:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e646106d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1868789733978240:12345-0@lo:400:kworker.0 Request processed in 87us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216994.789333:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:2.0:1782216994.789358:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782216994.789397:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f7a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1868789733978240:0@lo:400:kworker.0 00000001:00100000:1.0:1782216994.911976:0:7488:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 10ba4d21-74e8-42e8-8e52-48a327751cbd 00000020:00000080:1.0:1782216994.911991:0:7488:0:(genops.c:906:class_export_put()) final put ffff88e67a470800/10ba4d21-74e8-42e8-8e52-48a327751cbd 00000020:00000080:3.0:1782216994.912266:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff88e67a470800/10ba4d21-74e8-42e8-8e52-48a327751cbd for lustre-OST0001 00000020:00000080:3.0:1782216994.912336:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff88e67a471000 for lustre-OST0001 00000100:00100000:1.0:1782216995.287779:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782216995.287810:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733978624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782216995.287941:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216995.288074:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733978624 00000100:00100000:0.0:1782216995.288085:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733978624 00000100:00100000:0.0:1782216995.288149:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1782216995.288160:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f7a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733978624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782216995.288206:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782216995.288262:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f7a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733978624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216995.288270:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1782216995.288323:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733978624:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782216995.423104:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216996.445660:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782216997.333791:0:11532:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1782216997.471627:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216997.846066:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f7a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733978752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782216997.846166:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216997.847737:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733978752 00000100:00100000:0.0:1782216997.847756:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733978752 00000100:00100000:0.0:1782216997.847860:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1782216997.847918:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e646107800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733978752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782216997.847971:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782216997.848070:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e646107800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733978752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 200us (1904us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216997.848078:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1782216997.848180:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67f7a2680 x1868789733978752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782217013 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216997.848210:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f7a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733978752:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782216997.848344:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782216998.484094:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216998.912087:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216998.912304:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782216998.912332:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782216998.912412:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714019712 00000100:00100000:1.0:1782216998.912430:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714019712 00000100:00100000:1.0:1782216998.912495:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714019584 00000100:00100000:1.0:1782216998.912499:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714019584 00000100:00100000:1.0:1782216998.912525:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 124 00000100:00100000:1.0:1782216998.912534:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2359:x1868789714019712:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:1.0:1782216998.912608:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2359:x1868789714019712:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 75us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216998.912615:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 124 00000100:00100000:1.0:1782216998.912632:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 125 00000100:00100000:1.0:1782216998.912638:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2359:x1868789714019584:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:1.0:1782216998.912660:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2359:x1868789714019584:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 23us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216998.912666:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 125 00000100:00080000:3.0:1782216998.912981:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782216998.922738:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714019456 00000100:00100000:0.0:1782216998.922750:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714019456 00000100:00100000:0.0:1782216998.922822:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 283 00000100:00100000:0.0:1782216998.922832:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2359:x1868789714019456:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:0.0:1782216998.922926:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2359:x1868789714019456:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 96us (10848us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216998.922933:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 283 00000001:02000400:2.0:1782216998.973361:0:11697:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 08:16:36 (1782216996) 00010000:00010000:3.0:1782216999.509208:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216999.893403:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1868789733979264:0@lo:400:kworker.0 00000100:00100000:1.0:1782216999.893454:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:526a4802-b871-4bcf-870f-067f11655366:3302:1868789733978880:0@lo:400:kworker.0 00000100:00100000:1.0:1782216999.893497:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216999.893541:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1868789733979392:0@lo:400:kworker.0 00000100:00100000:1.0:1782216999.893592:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733979136:0@lo:400:kworker.0 00000100:00100000:3.0:1782216999.893610:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216999.893636:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216999.893654:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733978880 00000100:00100000:1.0:1782216999.893656:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782216999.893660:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868789733979008:0@lo:400:kworker.0 00000100:00100000:3.0:1782216999.893661:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733978880 00000100:00100000:1.0:1782216999.893679:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216999.893693:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733979520:0@lo:400:kworker.0 00000100:00100000:3.0:1782216999.893699:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1782216999.893707:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+19:3302:x1868789733978880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216999.893711:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216999.893735:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733979136 00000100:00100000:1.0:1782216999.893738:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733979136 00000100:00100000:3.0:1782216999.893752:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+19:3302:x1868789733978880:12345-0@lo:400:kworker.0 Request processed in 45us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216999.893759:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1782216999.893771:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733979520 00000100:00100000:1.0:1782216999.893773:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733979520 00000100:00100000:3.0:1782216999.893787:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733979264 00000100:00100000:3.0:1782216999.893790:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733979264 00000100:00100000:1.0:1782216999.893791:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1782216999.893797:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f7a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733979136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216999.893814:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733979008 00000100:00100000:3.0:1782216999.893816:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733979008 00000100:00100000:1.0:1782216999.893831:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f7a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733979136:12345-0@lo:400:kworker.0 Request processed in 35us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216999.893834:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1782216999.893838:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1782216999.893846:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f759180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1868789733979264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216999.893850:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782216999.893855:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f7a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733979520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216999.893874:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f7a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733979520:12345-0@lo:400:kworker.0 Request processed in 19us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216999.893894:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f759180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1868789733979264:12345-0@lo:400:kworker.0 Request processed in 32us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216999.893898:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1782216999.893900:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1782216999.893910:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1782216999.893915:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f7a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868789733979008:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1782216999.893937:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782216999.893942:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f7a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868789733979008:12345-0@lo:400:kworker.0 Request processed in 27us (262us total) trans 0 rc 0/0 00000100:00080000:1.0:1782216999.893942:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782216999.893943:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782216999.893947:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1782216999.893967:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216999.893974:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868789733979008:0@lo:400:kworker.0 00000100:00100000:1.0:1782216999.893984:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733979520:0@lo:400:kworker.0 00000100:00100000:3.0:1782216999.893988:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:526a4802-b871-4bcf-870f-067f11655366:3302:1868789733978880:0@lo:400:kworker.0 00010000:00080000:1.0:1782216999.893994:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e648b95500 x1868789733979136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782217015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216999.894005:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733979392 00000100:00100000:3.0:1782216999.894008:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733979392 00000100:00100000:3.0:1782216999.894033:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1782216999.894038:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6454aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1868789733979392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216999.894070:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6454aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1868789733979392:12345-0@lo:400:kworker.0 Request processed in 32us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216999.894075:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:3.0:1782216999.894086:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782216999.894249:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733979136:0@lo:400:kworker.0 00000100:00100000:3.0:1782216999.894283:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1868789733979392:0@lo:400:kworker.0 00000100:00100000:1.0:1782216999.894286:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1868789733979264:0@lo:400:kworker.0 00000100:00100000:3.0:1782217000.327794:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217000.328104:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714019840 00000100:00100000:1.0:1782217000.328115:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714019840 00000100:00100000:1.0:1782217000.328193:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 32 00000100:00100000:1.0:1782217000.328205:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6454a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:10224:x1868789714019840:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782217000.328226:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217000.328248:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089eda9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62026d expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217000.328314:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089edb0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217000.328328:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089edb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217000.328340:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089edb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217000.328802:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782217000.328807:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1782217000.328938:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089edb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217000.330719:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089eda9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62026d expref: 7 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217000.330743:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089edb0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62026d expref: 6 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217000.330769:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e67a811d00) 00010000:00010000:1.0:1782217000.330773:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782217000.330777:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd07200, rc 0) 00000100:00100000:1.0:1782217000.330855:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6454a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:10224:x1868789714019840:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 2652us (3068us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217000.330863:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 32 00000100:00080000:3.0:1782217000.331712:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782217000.336353:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217000.336496:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714019968 00000100:00100000:3.0:1782217000.336509:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714019968 00000100:00100000:3.0:1782217000.336634:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 33 00000100:00100000:3.0:1782217000.336648:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:10225:x1868789714019968:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782217000.336689:0:6855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217000.336716:0:6855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089edb7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620274 expref: -99 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217000.336817:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089edbe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217000.336836:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089edbe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217000.336850:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089edbe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217000.336868:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089edc5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217000.336929:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089edc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217000.336938:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089edc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217000.337543:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030a00/0xf210a9075089edcc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217000.337556:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030a00/0xf210a9075089edcc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217000.337565:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030a00/0xf210a9075089edcc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217000.337662:0:6855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1782217000.337674:0:6855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1782217000.337770:0:6855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030a00/0xf210a9075089edcc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217000.337784:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089edbe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217000.337791:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089edbe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217000.337799:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089edbe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217000.337806:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640031600 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217000.337811:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089edbe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217000.337819:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089edbe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217000.337835:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e67a811d00) 00010000:00010000:3.0:1782217000.337838:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217000.337844:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089edbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217000.337850:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089edbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217000.337865:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089edc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217000.337871:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089edc5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217000.337933:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089edc5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217000.337939:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640031e00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217000.337942:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089edc5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217000.337949:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089edc5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217000.337958:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff88e650a64300) 00010000:00010000:3.0:1782217000.337960:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217000.337963:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089edc5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217000.337969:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089edc5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217000.338015:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089edb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620274 expref: 8 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217000.338031:0:6855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030a00/0xf210a9075089edcc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620274 expref: 7 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217000.338038:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88e650a64b00) 00010000:00010000:3.0:1782217000.338040:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782217000.338043:0:6855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e640030a00, rc 0) 00000100:00100000:3.0:1782217000.338131:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:10225:x1868789714019968:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 1486us (1792us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217000.338149:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 33 00000100:00100000:0.0:1782217000.340910:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217000.341005:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714020224 00000100:00100000:1.0:1782217000.341018:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714020224 00000100:00100000:1.0:1782217000.341090:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 34 00000100:00100000:1.0:1782217000.341102:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:10225:x1868789714020224:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782217000.341132:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217000.341160:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089edd3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62027b expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217000.341388:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089edda lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217000.341406:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089edda lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217000.341431:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089edda lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217000.341448:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089ede1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217000.341456:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089ede1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217000.341491:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089ede1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217000.345654:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07000/0xf210a9075089ede8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217000.345685:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07000/0xf210a9075089ede8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217000.345699:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07000/0xf210a9075089ede8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217000.345714:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1782217000.346112:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089edda lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217000.346121:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089edda lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217000.346129:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089edda lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217000.346137:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217000.346142:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089edda lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217000.346150:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089edda lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217000.346167:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88e650a64b00) 00010000:00010000:1.0:1782217000.346170:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217000.346254:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089edda lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217000.346264:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089edda lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217000.346282:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089ede1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217000.346288:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089ede1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217000.346295:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089ede1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217000.346301:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217000.346305:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089ede1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217000.346311:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089ede1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217000.346320:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff88e67a811200) 00010000:00010000:1.0:1782217000.346322:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217000.346326:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089ede1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217000.346332:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089ede1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217000.347054:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089edd3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62027b expref: 10 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217000.347088:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07000/0xf210a9075089ede8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62027b expref: 9 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217000.347096:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88e67a811700) 00010000:00010000:1.0:1782217000.347100:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217000.347103:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd07000, rc 0) 00000100:00100000:1.0:1782217000.347311:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+9:10225:x1868789714020224:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 6209us (6447us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1782217000.347321:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 34 00000100:00100000:2.0:1782217000.351392:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217000.352099:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714020352 00000100:00100000:0.0:1782217000.352113:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714020352 00000100:00100000:0.0:1782217000.352250:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 35 00000100:00100000:0.0:1782217000.352272:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e646104e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+9:10225:x1868789714020352:12345-192.168.203.19@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1782217000.352729:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e646104e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+9:10225:x1868789714020352:12345-192.168.203.19@tcp:59:lhsmtool_posix.0 Request processed in 464us (1347us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217000.352740:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 35 00000100:00100000:2.0:1782217000.405353:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782217000.405383:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733979648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782217000.405487:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217000.405751:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733979648 00000100:00100000:0.0:1782217000.405761:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733979648 00000100:00100000:0.0:1782217000.405826:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1782217000.405837:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733979648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782217000.405900:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782217000.405964:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733979648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217000.406111:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733979648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782217000.406276:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000040:00080000:3.0:1782217000.407335:0:11532:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1782217000.532330:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217001.557098:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217002.120712:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217002.122136:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714020480 00000100:00100000:2.0:1782217002.122153:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714020480 00000100:00100000:2.0:1782217002.122294:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 36 00000100:00100000:2.0:1782217002.122308:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+9:10267:x1868789714020480:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:2.0:1782217002.122334:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217002.122359:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089edf6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620282 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.122455:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aee00/0xf210a9075089edfd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.122487:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aee00/0xf210a9075089edfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.122502:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aee00/0xf210a9075089edfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.122521:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afe00/0xf210a9075089ee04 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.122529:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afe00/0xf210a9075089ee04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.122536:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afe00/0xf210a9075089ee04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.122850:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aee00/0xf210a9075089edfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.122873:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aee00/0xf210a9075089edfd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.122909:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aee00/0xf210a9075089edfd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.122916:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738aee00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217002.122920:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aee00/0xf210a9075089edfd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.122929:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aee00/0xf210a9075089edfd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.122943:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e67a811d00) 00010000:00010000:2.0:1782217002.122953:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217002.122959:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aee00/0xf210a9075089edfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.122966:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aee00/0xf210a9075089edfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.122979:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afe00/0xf210a9075089ee04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.122984:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afe00/0xf210a9075089ee04 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.122991:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afe00/0xf210a9075089ee04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.123223:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738afe00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217002.123226:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afe00/0xf210a9075089ee04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.123232:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afe00/0xf210a9075089ee04 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.123240:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff88e65417f500) 00010000:00010000:2.0:1782217002.123243:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217002.123246:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afe00/0xf210a9075089ee04 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.123252:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afe00/0xf210a9075089ee04 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.123295:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089edf6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620282 expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.123319:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e67a811d00) 00010000:00010000:2.0:1782217002.123321:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217002.123325:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089edf6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620282 expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.123334:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738af200, rc 0) 00000100:00100000:2.0:1782217002.123500:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+9:10267:x1868789714020480:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 1194us (2800us total) trans 0 rc 301/301 00000100:00100000:2.0:1782217002.123509:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 36 00000100:00080000:3.0:1782217002.125608:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782217002.128259:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217002.128325:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714020736 00000100:00100000:1.0:1782217002.128339:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714020736 00000100:00100000:1.0:1782217002.128418:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 37 00000100:00100000:1.0:1782217002.128431:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+9:10267:x1868789714020736:12345-192.168.203.19@tcp:36:lfs.0 00010000:00010000:1.0:1782217002.128555:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217002.128582:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089edb0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62026d expref: 9 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.128600:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e67a811d00) 00010000:00010000:1.0:1782217002.128611:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782217002.129319:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ee0b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.129337:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ee0b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.129348:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ee0b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.129368:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089ee12 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.129375:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089ee12 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.129382:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089ee12 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217002.135116:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1782217002.135137:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ee0b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.135320:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ee0b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.135328:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ee0b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.135334:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06c00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217002.135339:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ee0b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.135346:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ee0b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.135362:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e67a811300) 00010000:00010000:1.0:1782217002.135366:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217002.135370:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ee0b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.135390:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ee0b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782217002.135419:0:5785:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005b6754fb reply state 000000006c239b91 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089ee12 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217002.135429:0:5785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782217002.137097:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+10:10267:x1868789714020736:12345-192.168.203.19@tcp:36:lfs.0 Request processed in 8659us (8843us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1782217002.137109:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 37 00010000:00010000:3.0:1782217002.145702:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089ee12 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.145721:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089ee12 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.145729:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089ee12 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.145735:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07e00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217002.145740:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089ee12 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.145747:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089ee12 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.145765:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff88e67a811500) 00010000:00010000:3.0:1782217002.145768:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217002.145772:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089ee12 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.145777:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089ee12 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217002.237065:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217002.237110:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714020864 00000100:00100000:2.0:1782217002.237120:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714020864 00000100:00100000:2.0:1782217002.237171:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 38 00000100:00100000:2.0:1782217002.237180:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+9:10275:x1868789714020864:12345-192.168.203.19@tcp:101:lctl.0 00010000:00010000:2.0:1782217002.237202:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217002.237223:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afe00/0xf210a9075089ee19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620289 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.237284:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aee00/0xf210a9075089ee20 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.237296:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aee00/0xf210a9075089ee20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.237307:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aee00/0xf210a9075089ee20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217002.237380:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782217002.237384:0:5783:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1782217002.237430:0:5783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aee00/0xf210a9075089ee20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.237455:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afe00/0xf210a9075089ee19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620289 expref: 11 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.237479:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aee00/0xf210a9075089ee20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620289 expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.237488:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e65417f500) 00010000:00010000:2.0:1782217002.237491:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782217002.237495:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738aee00, rc 0) 00000100:00100000:2.0:1782217002.237547:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+10:10275:x1868789714020864:12345-192.168.203.19@tcp:101:lctl.0 Request processed in 368us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217002.237555:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 38 00000100:00100000:2.0:1782217002.306037:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217002.306131:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714020992 00000100:00100000:3.0:1782217002.306153:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714020992 00000100:00100000:3.0:1782217002.306216:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 39 00000100:00100000:3.0:1782217002.306227:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+10:10281:x1868789714020992:12345-192.168.203.19@tcp:101:bash.0 00010000:00010000:3.0:1782217002.306248:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217002.306268:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089ee27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620290 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.306331:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089ee2e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.306344:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089ee2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.306356:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089ee2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.306369:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ee35 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.306376:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ee35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.306383:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ee35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.306504:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030400/0xf210a9075089ee3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.306512:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030400/0xf210a9075089ee3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.306519:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030400/0xf210a9075089ee3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217002.306562:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1782217002.306566:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782217002.306787:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030400/0xf210a9075089ee3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.306801:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089ee2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.306807:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089ee2e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.306814:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089ee2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.306820:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640030200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217002.306824:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089ee2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.306943:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089ee2e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.306956:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e65417f500) 00010000:00010000:3.0:1782217002.306960:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217002.306964:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089ee2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.306971:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089ee2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.306985:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ee35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.307003:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ee35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.307009:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ee35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.307014:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640031e00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217002.307017:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ee35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.307024:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ee35 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.307031:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff88e650a64600) 00010000:00010000:3.0:1782217002.307034:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217002.307036:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ee35 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.307042:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ee35 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.307075:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089ee27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620290 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.307088:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030400/0xf210a9075089ee3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620290 expref: 11 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.307095:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88e650a64700) 00010000:00010000:3.0:1782217002.307097:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782217002.307105:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e640030400, rc 0) 00000100:00100000:3.0:1782217002.307210:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+11:10281:x1868789714020992:12345-192.168.203.19@tcp:101:bash.0 Request processed in 985us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217002.307218:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 39 00000100:00100000:2.0:1782217002.318549:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217002.318755:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714021248 00000100:00100000:0.0:1782217002.318765:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714021248 00000100:00100000:0.0:1782217002.318825:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 40 00000100:00100000:0.0:1782217002.318843:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f192a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+11:10281:x1868789714021248:12345-192.168.203.19@tcp:101:bash.0 00010000:00010000:0.0:1782217002.318871:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217002.318939:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089ee43 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620297 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217002.319072:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a9075089ee4a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217002.319087:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a9075089ee4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217002.319098:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a9075089ee4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217002.319161:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089ee51 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217002.319169:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089ee51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217002.319177:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089ee51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782217002.319869:0:5783:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1782217002.320073:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089ee58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217002.320084:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089ee58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217002.320092:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089ee58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217002.320136:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a9075089ee4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217002.320144:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a9075089ee4a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217002.320151:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a9075089ee4a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217002.320157:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437ac00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217002.320161:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a9075089ee4a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217002.320169:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a9075089ee4a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217002.320181:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88e650a64700) 00010000:00010000:0.0:1782217002.320184:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217002.320189:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a9075089ee4a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217002.320195:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a9075089ee4a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782217002.320206:0:5783:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f8bd87da reply state 0000000097679050 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089ee51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217002.320215:0:5783:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782217002.320242:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089ee43 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620297 expref: 14 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217002.320266:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089ee58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620297 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217002.320273:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e647d05c00) 00010000:00010000:0.0:1782217002.320275:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782217002.320278:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437aa00, rc 0) 00000100:00100000:0.0:1782217002.320340:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f192a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+14:10281:x1868789714021248:12345-192.168.203.19@tcp:101:bash.0 Request processed in 1498us (1800us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1782217002.320348:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 40 00010000:00010000:1.0:1782217002.330490:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089ee51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.330508:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089ee51 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.330517:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089ee51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.330522:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437b200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217002.330527:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089ee51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.330533:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089ee51 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.330549:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88e647d05900) 00010000:00010000:1.0:1782217002.330552:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217002.330556:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089ee51 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.330581:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089ee51 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217002.336824:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217002.336920:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714021376 00000100:00100000:1.0:1782217002.336929:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714021376 00000100:00100000:1.0:1782217002.336981:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 21 00000100:00100000:1.0:1782217002.336990:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f191500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2355:x1868789714021376:12345-192.168.203.19@tcp:8:bash.0 00010000:00080000:1.0:1782217002.337019:0:6578:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 10ba4d21-74e8-42e8-8e52-48a327751cbd@192.168.203.19@tcp t0 exp 0000000000000000 cur 321 last 0 00000020:00000080:1.0:1782217002.337048:0:6578:0:(genops.c:1406:class_connect()) connect: client 10ba4d21-74e8-42e8-8e52-48a327751cbd, cookie 0xf210a9075089ee66 00002000:00100000:1.0:1782217002.337059:0:6578:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 10ba4d21-74e8-42e8-8e52-48a327751cbd/ffff88e6755cc800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782217002.337083:0:6578:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782217002.337302:0:6578:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1782217002.337329:0:6578:0:(import.c:65:import_set_state_nolock()) ffff88e6755ce800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782217002.337408:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f191500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2355:x1868789714021376:12345-192.168.203.19@tcp:8:bash.0 Request processed in 417us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217002.337416:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 21 00000100:00100000:0.0:1782217002.344482:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217002.344553:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714021504 00000100:00100000:1.0:1782217002.344564:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714021504 00000100:00080000:3.0:1782217002.344613:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782217002.344642:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 22 00000100:00100000:1.0:1782217002.344651:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a814380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:0:x1868789714021504:12345-192.168.203.19@tcp:101:bash.0 00010000:00010000:1.0:1782217002.344673:0:7991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217002.344691:0:7991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b3a3bf3/0xf210a9075089ee6d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62029e expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782217002.344712:0:7991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217002.344738:0:7991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=321s v=(0 0) 00010000:00010000:1.0:1782217002.344741:0:7991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217002.344748:0:7991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b3a3bf3/0xf210a9075089ee6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62029e expref: 7 pid: 7991 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.344763:0:7991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b3a3bf3/0xf210a9075089ee6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62029e expref: 7 pid: 7991 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.344773:0:7991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd07a00, rc 0) 00000100:00100000:1.0:1782217002.344818:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a814380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:0:x1868789714021504:12345-192.168.203.19@tcp:101:bash.0 Request processed in 167us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217002.344825:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 22 00000100:00100000:3.0:1782217002.348263:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217002.348358:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714021632 00000100:00100000:0.0:1782217002.348366:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714021632 00000100:00100000:0.0:1782217002.348437:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 23 00000100:00100000:0.0:1782217002.348447:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:10281:x1868789714021632:12345-192.168.203.19@tcp:101:bash.0 00010000:00010000:0.0:1782217002.348464:0:6578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217002.348483:0:6578:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032e2b5b4/0xf210a9075089ee74 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6202a5 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217002.348523:0:6578:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b3a3bf3/0xf210a9075089ee6d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62029e expref: 8 pid: 7991 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217002.348531:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217002.348535:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217002.348539:0:6578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032e2b5b4/0xf210a9075089ee74 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202a5 expref: 8 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217002.348587:0:6578:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003b3a3bf3/0xf210a9075089ee6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62029e expref: 8 pid: 7991 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217002.348600:0:6578:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003b3a3bf3/0xf210a9075089ee6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62029e expref: 8 pid: 7991 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217002.348615:0:6578:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a817480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6578:1868789733979776:192.168.203.19@tcp:104: 00000100:00100000:0.0:1782217002.348698:0:6578:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6445a0300 going to sleep for 11 seconds 00000100:00100000:3.0:1782217002.352334:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217002.352460:0:6578:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a817480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6578:1868789733979776:192.168.203.19@tcp:104: 00010000:00010000:0.0:1782217002.352491:0:6578:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000032e2b5b4/0xf210a9075089ee74 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202a5 expref: 8 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217002.352510:0:6578:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437a600, rc 0) 00000100:00100000:0.0:1782217002.352563:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+8:10281:x1868789714021632:12345-192.168.203.19@tcp:101:bash.0 Request processed in 4118us (4427us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217002.352571:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 23 00000100:00100000:1.0:1782217002.352755:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714021760 00000100:00100000:1.0:1782217002.352761:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714021760 00010000:00010000:1.0:1782217002.352792:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003b3a3bf3/0xf210a9075089ee6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62029e expref: 8 pid: 7991 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217002.352820:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 35 00000100:00100000:1.0:1782217002.352838:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+8:2359:x1868789714021760:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782217002.352851:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217002.352870:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003b3a3bf3/0xf210a9075089ee6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62029e expref: 8 pid: 7991 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.353013:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003b3a3bf3/0xf210a9075089ee6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62029e expref: 8 pid: 7991 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.353053:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b3a3bf3/0xf210a9075089ee6d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62029e expref: 8 pid: 7991 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.353067:0:5768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217002.353071:0:5768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217002.353078:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000032e2b5b4/0xf210a9075089ee74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202a5 expref: 7 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.353087:0:5768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032e2b5b4/0xf210a9075089ee74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202a5 expref: 7 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.353119:0:5768:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000032e2b5b4/0xf210a9075089ee74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202a5 expref: 7 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217002.353133:0:5768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f7a2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5768:1868789733979904:192.168.203.19@tcp:105: 00000100:00100000:1.0:1782217002.353195:0:5768:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64e3803c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782217002.357356:0:5768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f7a2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5768:1868789733979904:192.168.203.19@tcp:105: 00010000:00010000:1.0:1782217002.357383:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782217002.357448:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:2359:x1868789714021760:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 4619us (5121us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217002.357459:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 35 00000100:00100000:3.0:1782217002.358086:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217002.358153:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714022016 00000100:00100000:0.0:1782217002.358161:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714022016 00000100:00100000:0.0:1782217002.358205:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 6 00000100:00100000:0.0:1782217002.358214:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+13:10281:x1868789714022016:12345-192.168.203.19@tcp:35:bash.0 00000100:00100000:0.0:1782217002.358543:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+14:10281:x1868789714022016:12345-192.168.203.19@tcp:35:bash.0 Request processed in 329us (457us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1782217002.358551:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 6 00000100:00100000:3.0:1782217002.432180:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217002.432302:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714022272 00000100:00100000:1.0:1782217002.432312:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714022272 00000100:00100000:1.0:1782217002.432374:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 41 00000100:00100000:1.0:1782217002.432408:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+14:10291:x1868789714022272:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:1.0:1782217002.432434:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217002.432454:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ee7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6202ac expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217002.432578:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1782217002.432701:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ee7b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202ac expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.432715:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e65417f500) 00010000:00010000:1.0:1782217002.432719:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782217002.432724:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ee7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202ac expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.432736:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd07a00, rc 0) 00000100:00100000:1.0:1782217002.432844:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+15:10291:x1868789714022272:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 447us (676us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1782217002.432851:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 41 00000100:00100000:3.0:1782217002.438434:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217002.438619:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714022528 00000100:00100000:0.0:1782217002.438629:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714022528 00000100:00100000:0.0:1782217002.438681:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 7 00000100:00100000:0.0:1782217002.438690:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67426dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+15:10291:x1868789714022528:12345-192.168.203.19@tcp:35:lfs.0 00000100:00100000:0.0:1782217002.440029:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67426dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+16:10291:x1868789714022528:12345-192.168.203.19@tcp:35:lfs.0 Request processed in 1332us (1596us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1782217002.440041:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 7 00000100:00100000:0.0:1782217002.578067:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217002.578163:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714022656 00000100:00100000:2.0:1782217002.578173:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714022656 00000100:00100000:2.0:1782217002.578233:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 42 00000100:00100000:2.0:1782217002.578243:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+16:10297:x1868789714022656:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:2.0:1782217002.578268:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217002.578288:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afe00/0xf210a9075089ee89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6202b3 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.578384:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089ee90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.578405:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089ee90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.578416:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089ee90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217002.578473:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1782217002.578477:0:5783:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1782217002.578503:0:5783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089ee90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.578528:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afe00/0xf210a9075089ee89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202b3 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.578545:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089ee90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202b3 expref: 17 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.578554:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88e650a64700) 00010000:00010000:2.0:1782217002.578557:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782217002.578560:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738af600, rc 0) 00000100:00100000:2.0:1782217002.578632:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+17:10297:x1868789714022656:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 391us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217002.578640:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 42 00010000:00010000:1.0:1782217002.581018:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217002.590604:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217002.592966:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714022912 00000100:00100000:1.0:1782217002.592980:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714022912 00000100:00100000:1.0:1782217002.593060:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 43 00000100:00100000:1.0:1782217002.593070:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f62ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+17:10297:x1868789714022912:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:1.0:1782217002.593090:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217002.593110:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ee97 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6202ba expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.593224:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089ee9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.593238:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089ee9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.593248:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089ee9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217002.593259:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1782217002.593390:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ee97 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202ba expref: 20 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.593418:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089ee9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202ba expref: 19 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.593427:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e647d05c00) 00010000:00010000:1.0:1782217002.593431:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782217002.593434:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd06600, rc 0) 00000100:00100000:1.0:1782217002.593502:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f62ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+19:10297:x1868789714022912:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 432us (2906us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1782217002.593509:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 43 00000100:00100000:0.0:1782217002.599671:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217002.599715:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217002.599859:0:8300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714023296 00000100:00100000:1.0:1782217002.599868:0:8300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714023296 00000100:00100000:1.0:1782217002.599957:0:8300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 1 00000100:00100000:1.0:1782217002.599968:0:8300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a817800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+19:2357:x1868789714023296:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782217002.599983:0:8300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217002.600023:0:8300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089ee9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202ba expref: 19 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.600041:0:8300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e647d05c00) 00010000:00010000:1.0:1782217002.600046:0:8300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782217002.600093:0:8300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a817800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+18:2357:x1868789714023296:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 127us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217002.600101:0:8300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 1 00000100:00100000:2.0:1782217002.600172:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714023168 00000100:00100000:2.0:1782217002.600177:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714023168 00000100:00100000:2.0:1782217002.600223:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 44 00000100:00100000:2.0:1782217002.600230:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+18:10297:x1868789714023168:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:2.0:1782217002.600249:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217002.600262:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afe00/0xf210a9075089eeac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6202c1 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.600347:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae600/0xf210a9075089eeb3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.600361:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae600/0xf210a9075089eeb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.600372:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae600/0xf210a9075089eeb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217002.600401:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1782217002.600525:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afe00/0xf210a9075089eeac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202c1 expref: 21 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.600541:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae600/0xf210a9075089eeb3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202c1 expref: 20 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.600550:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e647d05c00) 00010000:00010000:2.0:1782217002.600553:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1782217002.600555:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738ae600, rc 0) 00000100:00100000:2.0:1782217002.600581:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+20:10297:x1868789714023168:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 352us (936us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1782217002.600588:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 44 00000100:00100000:0.0:1782217002.612069:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217002.612163:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714023424 00000100:00100000:1.0:1782217002.612172:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714023424 00000100:00100000:1.0:1782217002.612230:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 24 00000100:00100000:1.0:1782217002.612239:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:2358:x1868789714023424:12345-192.168.203.19@tcp:1:lfs.0 00010000:00010000:1.0:1782217002.612279:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec35c3a2/0xf210a9075089eec1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.612307:0:7991:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000032e2b5b4/0xf210a9075089ee74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202a5 expref: 7 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.612317:0:7991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217002.612321:0:7991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782217002.612325:0:7991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec35c3a2/0xf210a9075089eec1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.612357:0:7991:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000032e2b5b4/0xf210a9075089ee74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202a5 expref: 7 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.612370:0:7991:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000032e2b5b4/0xf210a9075089ee74 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202a5 expref: 7 pid: 6578 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217002.612415:0:7991:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f7a2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7991:1868789733980032:192.168.203.19@tcp:104: 00000100:00100000:1.0:1782217002.612504:0:7991:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64e3803c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782217002.615777:0:7991:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f7a2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7991:1868789733980032:192.168.203.19@tcp:104: 00010000:00010000:1.0:1782217002.615807:0:7991:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ec35c3a2/0xf210a9075089eec1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217002.616001:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217002.616128:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714023552 00000100:00100000:1.0:1782217002.616135:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714023552 00002000:00100000:1.0:1782217002.616178:0:6583:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff88e67a816a00 x1868789714023552/t0(0) o4->10ba4d21-74e8-42e8-8e52-48a327751cbd@192.168.203.19@tcp:253/0 lens 504/0 e 0 to 0 dl 1782217013 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782217002.616188:0:6583:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff88e67a816a00 with x1868789714023552 ext(0->12) 00010000:00010000:1.0:1782217002.616195:0:6583:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000032e2b5b4/0xf210a9075089ee74 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202a5 expref: 8 pid: 6578 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.616209:0:6583:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000032e2b5b4/0xf210a9075089ee74 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202a5 expref: 8 pid: 6578 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782217002.616216:0:6583:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88e67a816a00 00000100:00100000:1.0:1782217002.616246:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 0 00000100:00100000:1.0:1782217002.616255:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a816a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+8:2358:x1868789714023552:12345-192.168.203.19@tcp:4:lfs.0 00000001:00100000:0.0:1782217002.692441:0:6609:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 10ba4d21-74e8-42e8-8e52-48a327751cbd 00000100:00100000:1.0:1782217002.693273:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a816a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+9:2358:x1868789714023552:12345-192.168.203.19@tcp:4:lfs.0 Request processed in 77013us (77268us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1782217002.693284:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 0 00002000:00100000:1.0:1782217002.693305:0:6583:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff88e67a816a00 x1868789714023552/t4294967299(0) o4->10ba4d21-74e8-42e8-8e52-48a327751cbd@192.168.203.19@tcp:253/0 lens 504/448 e 0 to 0 dl 1782217013 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782217002.693315:0:6583:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff88e67a816a00 with x1868789714023552 ext(0->12) 00010000:00010000:1.0:1782217002.693326:0:6583:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000032e2b5b4/0xf210a9075089ee74 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202a5 expref: 9 pid: 6578 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.693343:0:6583:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000032e2b5b4/0xf210a9075089ee74 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202a5 expref: 9 pid: 6578 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782217002.693351:0:6583:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88e67a816a00 00000100:00100000:0.0:1782217002.699410:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217002.699474:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714023680 00000100:00100000:2.0:1782217002.699496:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714023680 00010000:00010000:2.0:1782217002.699534:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000032e2b5b4/0xf210a9075089ee74 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202a5 expref: 9 pid: 6578 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217002.699577:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 36 00000100:00100000:2.0:1782217002.699587:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652501180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+9:2359:x1868789714023680:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217002.699604:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1782217002.699621:0:5769:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1782217002.699624:0:5769:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1782217001 00002000:00010000:2.0:1782217002.699626:0:5769:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1782217001 00002000:00010000:2.0:1782217002.699628:0:5769:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1782217001 00010000:00010000:2.0:1782217002.699634:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000032e2b5b4/0xf210a9075089ee74 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202a5 expref: 9 pid: 6578 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.699649:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000032e2b5b4/0xf210a9075089ee74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202a5 expref: 9 pid: 6578 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.699674:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032e2b5b4/0xf210a9075089ee74 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202a5 expref: 9 pid: 6578 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.699691:0:5769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782217002.699695:0:5769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782217002.699700:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ec35c3a2/0xf210a9075089eec1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.699711:0:5769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec35c3a2/0xf210a9075089eec1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.699756:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782217002.699804:0:7991:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ec35c3a2/0xf210a9075089eec1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217002.699809:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652501180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+8:2359:x1868789714023680:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 224us (415us total) trans 0 rc 0/0 00010000:00010000:1.0:1782217002.699815:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec35c3a2/0xf210a9075089eec1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217002.699817:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 36 00010000:00010000:1.0:1782217002.699840:0:7991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec35c3a2/0xf210a9075089eec1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.699849:0:7991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec35c3a2/0xf210a9075089eec1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.699856:0:7991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec35c3a2/0xf210a9075089eec1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.699863:0:7991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06600 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:1.0:1782217002.699874:0:7991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec35c3a2/0xf210a9075089eec1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.700441:0:7991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec35c3a2/0xf210a9075089eec1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.700455:0:7991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec35c3a2/0xf210a9075089eec1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.700464:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec35c3a2/0xf210a9075089eec1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217002.700522:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:2358:x1868789714023424:12345-192.168.203.19@tcp:1:lfs.0 Request processed in 88283us (88461us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217002.700531:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 24 00000100:00100000:0.0:1782217002.706244:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217002.706316:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714023936 00000100:00100000:1.0:1782217002.706325:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714023936 00000100:00100000:1.0:1782217002.706380:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 8 00000100:00100000:1.0:1782217002.706390:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+20:10297:x1868789714023936:12345-192.168.203.19@tcp:35:lfs.0 00000004:00010000:1.0:1782217002.706458:0:5786:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae600/0xf210a9075089eeb3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202c1 expref: 20 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782217002.707016:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1782217002.707080:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1782217002.710287:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1782217002.710474:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089eec8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.710510:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089ee58 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620297 expref: 24 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.710520:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089eec8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.710559:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089ee58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620297 expref: 24 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.710573:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089ee58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620297 expref: 24 pid: 5783 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217002.710587:0:5786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f7a2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5786:1868789733980160:192.168.203.19@tcp:104: 00000100:00100000:1.0:1782217002.710944:0:5786:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64e380900 going to sleep for 11 seconds 00000100:00100000:0.0:1782217002.715862:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217002.716012:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714024064 00000100:00100000:3.0:1782217002.716020:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714024064 00010000:00010000:3.0:1782217002.716059:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089ee58 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620297 expref: 25 pid: 5783 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217002.716116:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 37 00000100:00100000:3.0:1782217002.716126:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652502300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+25:2358:x1868789714024064:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217002.716143:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217002.716149:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089ee58 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620297 expref: 25 pid: 5783 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.716162:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089ee58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620297 expref: 25 pid: 5783 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.716184:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e647d05c00) 00010000:00010000:3.0:1782217002.716189:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089eec8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.716216:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089eec8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.716224:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089eec8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.716244:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217002.716300:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652502300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+25:2358:x1868789714024064:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 175us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217002.716309:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 37 00010000:00010000:1.0:1782217002.718342:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089ee58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620297 expref: 24 pid: 5783 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217002.718367:0:5786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f7a2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5786:1868789733980160:192.168.203.19@tcp:104: 00010000:00010000:1.0:1782217002.718389:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089eec8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.718410:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089eec8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.718417:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089eec8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782217002.718535:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1782217002.719260:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1782217002.719385:0:5786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f7a2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5786:1868789733980288:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1782217002.719459:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217002.719494:0:5786:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64e380840 going to sleep for 11 seconds 00000100:00100000:3.0:1782217002.719805:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733980288 00000100:00100000:3.0:1782217002.719813:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733980288 00000100:00100000:3.0:1782217002.719903:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782217002.719913:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f7a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5786:x1868789733980288:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1782217002.719983:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f7a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5786:x1868789733980288:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 71us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217002.719990:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782217002.720024:0:5786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f7a2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5786:1868789733980288:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1782217002.720644:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1782217002.720722:0:5786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f62ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5786:1868789733980416:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1782217002.720760:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217002.720789:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733980416 00000100:00100000:3.0:1782217002.720793:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733980416 00000100:00100000:3.0:1782217002.720813:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782217002.720819:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f62c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5786:x1868789733980416:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1782217002.720974:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f62c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5786:x1868789733980416:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 154us (213us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1782217002.720987:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782217002.721005:0:5786:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e67f2e5300 going to sleep for 11 seconds 00000100:00100000:3.0:1782217002.721023:0:5786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f62ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5786:1868789733980416:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1782217002.721062:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1782217002.721094:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089eec8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.721104:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089eec8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.721111:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089eec8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.721117:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07a00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217002.721122:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089eec8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.721130:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089eec8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.721144:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e647d05c00) 00010000:00010000:3.0:1782217002.721147:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1782217002.721152:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089eec8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.721159:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089eec8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782217002.721323:0:5786:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1782217002.721534:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1782217002.721553:0:5786:0:(osp_sync.c:1862:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 321773675547ns, next at 322773673437ns, rc = 0 00000001:00080000:3.0:1782217002.721575:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1782217002.721609:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e647d05c00) 00010000:00010000:3.0:1782217002.721612:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1782217002.721619:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae600/0xf210a9075089eeb3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202c1 expref: 28 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217002.721716:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+27:10297:x1868789714023936:12345-192.168.203.19@tcp:35:lfs.0 Request processed in 15328us (15481us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1782217002.721728:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 8 00000020:00080000:3.0:1782217002.721733:0:5786:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:1.0:1782217002.724439:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782217002.725195:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217002.725282:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714024192 00000100:00100000:1.0:1782217002.725291:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714024192 00000100:00100000:1.0:1782217002.725387:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 45 00000100:00100000:1.0:1782217002.725407:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+27:10297:x1868789714024192:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:1.0:1782217002.725432:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217002.725456:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089eecf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6202c8 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.725516:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089eecf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202c8 expref: 28 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.725531:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089eecf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202c8 expref: 28 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.725550:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e67a811200) 00010000:00010000:1.0:1782217002.725554:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782217002.725557:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd06600, rc 0) 00000100:00100000:1.0:1782217002.725624:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+28:10297:x1868789714024192:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 228us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217002.725632:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 45 00000100:00100000:0.0:1782217002.729838:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217002.730343:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714024448 00000100:00100000:2.0:1782217002.730353:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714024448 00000100:00100000:2.0:1782217002.730512:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 9 00000100:00100000:2.0:1782217002.730523:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664ed1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+28:10297:x1868789714024448:12345-192.168.203.19@tcp:35:lfs.0 00000100:00100000:2.0:1782217002.731249:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664ed1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+29:10297:x1868789714024448:12345-192.168.203.19@tcp:35:lfs.0 Request processed in 725us (1418us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1782217002.731259:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 9 00000100:00100000:2.0:1782217002.821451:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217002.821552:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714024704 00000100:00100000:0.0:1782217002.821563:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714024704 00000100:00100000:0.0:1782217002.821624:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 46 00000100:00100000:0.0:1782217002.821634:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+29:10307:x1868789714024704:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:0.0:1782217002.821670:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217002.821692:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089eed6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6202cf expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217002.821802:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1782217002.822211:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089eed6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202cf expref: 31 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.822225:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e65417f500) 00010000:00010000:2.0:1782217002.822228:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782217002.822232:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089eed6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202cf expref: 31 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217002.822245:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437ba00, rc 0) 00000100:00100000:2.0:1782217002.822303:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+30:10307:x1868789714024704:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 671us (861us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1782217002.822311:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 46 00000100:00100000:0.0:1782217002.827646:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217002.827727:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714024832 00000100:00100000:3.0:1782217002.827737:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714024832 00000100:00100000:3.0:1782217002.827798:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 47 00000100:00100000:3.0:1782217002.827808:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+30:10307:x1868789714024832:12345-192.168.203.19@tcp:34:lfs.0 00010000:00010000:3.0:1782217002.827928:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089eee4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.827946:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089eee4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.827958:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089eee4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.827973:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089eeeb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.827980:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089eeeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.827987:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089eeeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.828102:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089eef2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.828112:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089eef2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.828120:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089eef2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782217002.828162:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089eef2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.828176:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089eee4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.828183:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089eee4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.828191:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089eee4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.828198:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640031600 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217002.828202:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089eee4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.828211:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089eee4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.828223:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88e650a64700) 00010000:00010000:3.0:1782217002.828226:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217002.828231:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089eee4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.828244:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089eee4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.828258:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089eeeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.828265:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089eeeb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.828271:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089eeeb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.828623:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640031e00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217002.828627:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089eeeb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.828633:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089eeeb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.828642:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88e650a64600) 00010000:00010000:3.0:1782217002.828644:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217002.828647:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089eeeb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.828654:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089eeeb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.828669:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089eef2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.828674:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089eef2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.828686:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089eef2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.828692:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640030200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217002.828695:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089eef2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.828701:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089eef2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.828709:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e67a811200) 00010000:00010000:3.0:1782217002.828712:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217002.828715:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089eef2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217002.828720:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089eef2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217002.828794:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+30:10307:x1868789714024832:12345-192.168.203.19@tcp:34:lfs.0 Request processed in 985us (1154us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217002.828802:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 47 00000100:00100000:0.0:1782217002.833949:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217002.834099:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714025088 00000100:00100000:3.0:1782217002.834111:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714025088 00000100:00100000:3.0:1782217002.834207:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 10 00000100:00100000:3.0:1782217002.834217:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652500a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+30:10307:x1868789714025088:12345-192.168.203.19@tcp:35:lfs.0 00000100:00100000:3.0:1782217002.834582:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652500a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+31:10307:x1868789714025088:12345-192.168.203.19@tcp:35:lfs.0 Request processed in 365us (643us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1782217002.834591:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 10 00000100:00100000:2.0:1782217002.911787:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217002.913502:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714025344 00000100:00100000:1.0:1782217002.913515:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714025344 00000100:00100000:1.0:1782217002.913586:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 48 00000100:00100000:1.0:1782217002.913609:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f192680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+31:10310:x1868789714025344:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:1.0:1782217002.913634:0:6855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217002.914091:0:6855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089eef9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6202d6 expref: -99 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.914166:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ef00 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.914180:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ef00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.914190:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ef00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.914204:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089ef07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.914210:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089ef07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.914216:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089ef07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.914333:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ef0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.914341:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ef0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.914348:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ef0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217002.915755:0:6855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1782217002.916066:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ef00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.916077:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ef00 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.916084:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ef00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.916089:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07a00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217002.916094:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ef00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.916102:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ef00 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.916116:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88e650a64700) 00010000:00010000:1.0:1782217002.916119:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217002.916123:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ef00 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.916129:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ef00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.916142:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089ef07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.916148:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089ef07 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.916167:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089ef07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.916172:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217002.916175:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089ef07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.916180:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089ef07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.916187:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88e67a811300) 00010000:00010000:1.0:1782217002.916190:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217002.916192:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089ef07 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.916199:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089ef07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.916251:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089eef9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202d6 expref: 34 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.916265:0:6855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ef0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202d6 expref: 33 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.916273:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e67a811200) 00010000:00010000:1.0:1782217002.916275:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782217002.916278:0:6855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd06c00, rc 0) 00000100:00100000:1.0:1782217002.916419:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f192680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+33:10310:x1868789714025344:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 2813us (4641us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1782217002.916438:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 48 00000100:00100000:0.0:1782217002.923233:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217002.927941:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714025472 00000100:00100000:1.0:1782217002.927955:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714025472 00000100:00100000:1.0:1782217002.928020:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 49 00000100:00100000:1.0:1782217002.928031:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+33:10310:x1868789714025472:12345-192.168.203.19@tcp:54:lfs.0 00010000:00010000:1.0:1782217002.928098:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089ef1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.928114:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089ef1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.928127:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089ef1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.928155:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089ef1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.928162:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089ef1c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.928169:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089ef1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.928175:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07600 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217002.928179:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089ef1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.928186:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089ef1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.928197:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e67a811200) 00010000:00010000:1.0:1782217002.928213:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782217002.928217:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089ef1c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217002.928223:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089ef1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217002.928407:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+33:10310:x1868789714025472:12345-192.168.203.19@tcp:54:lfs.0 Request processed in 377us (5181us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217002.928415:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 49 00000100:00100000:0.0:1782217002.934181:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217002.934293:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714025728 00000100:00100000:2.0:1782217002.934303:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714025728 00000100:00100000:2.0:1782217002.934357:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 11 00000100:00100000:2.0:1782217002.935004:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a801880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+33:10310:x1868789714025728:12345-192.168.203.19@tcp:35:lfs.0 00000100:00100000:2.0:1782217002.935226:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a801880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+34:10310:x1868789714025728:12345-192.168.203.19@tcp:35:lfs.0 Request processed in 859us (1052us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1782217002.935234:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 11 00000100:00100000:3.0:1782217002.964250:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f7a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733980544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782217002.964320:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217002.964506:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733980544 00000100:00100000:1.0:1782217002.964514:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733980544 00000100:00100000:1.0:1782217002.964565:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1782217002.964575:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f62e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1868789733980544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782217002.964598:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782217002.964659:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f62e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1868789733980544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217002.964667:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1782217002.965115:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f7a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733980544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782217003.234655:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217003.234753:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714025984 00000100:00100000:0.0:1782217003.234763:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714025984 00000100:00100000:0.0:1782217003.234830:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 50 00000100:00100000:0.0:1782217003.234840:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f192300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+34:10341:x1868789714025984:12345-192.168.203.19@tcp:101:cat.0 00010000:00010000:0.0:1782217003.234866:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217003.234914:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089ef23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6202dd expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217003.235017:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089ef2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217003.235031:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089ef2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217003.235044:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089ef2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217003.235054:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1782217003.235196:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089ef23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202dd expref: 37 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217003.235214:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089ef2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202dd expref: 36 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217003.235221:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e67a811200) 00010000:00010000:0.0:1782217003.235236:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782217003.235240:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437b000, rc 0) 00000100:00100000:0.0:1782217003.235299:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f192300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+36:10341:x1868789714025984:12345-192.168.203.19@tcp:101:cat.0 Request processed in 461us (653us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1782217003.235306:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 50 00000100:00100000:0.0:1782217003.238930:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217003.239030:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714026240 00000100:00100000:3.0:1782217003.239040:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714026240 00000100:00100000:3.0:1782217003.239098:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 12 00000100:00100000:3.0:1782217003.239108:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+36:10341:x1868789714026240:12345-192.168.203.19@tcp:35:cat.0 00000100:00100000:3.0:1782217003.239349:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+37:10341:x1868789714026240:12345-192.168.203.19@tcp:35:cat.0 Request processed in 241us (426us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1782217003.239356:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 12 00000100:00100000:3.0:1782217003.240349:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217003.240527:0:8300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714026368 00000100:00100000:1.0:1782217003.240538:0:8300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714026368 00000100:00100000:1.0:1782217003.240690:0:8300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 2 00000100:00100000:1.0:1782217003.240702:0:8300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f62df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+37:2357:x1868789714026368:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782217003.240716:0:8300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217003.240740:0:8300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089ef2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202dd expref: 37 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.240760:0:8300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e67a811200) 00010000:00010000:1.0:1782217003.240764:0:8300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782217003.240831:0:8300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f62df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+36:2357:x1868789714026368:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 132us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217003.240840:0:8300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 2 00000100:00100000:0.0:1782217003.297231:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217003.297431:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714026624 00000100:00100000:1.0:1782217003.297445:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714026624 00000100:00100000:1.0:1782217003.297520:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 51 00000100:00100000:1.0:1782217003.297533:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fcb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+36:10347:x1868789714026624:12345-192.168.203.19@tcp:101:dd.0 00010000:00010000:1.0:1782217003.297565:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217003.297568:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1782217003.297604:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089ee90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202b3 expref: 36 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.297627:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88e650a64700) 00010000:00010000:1.0:1782217003.297633:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782217003.297650:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089ef38 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6202e4 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.297790:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089ef3f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.297807:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ef0e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202d6 expref: 36 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.297817:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089ef3f lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.297861:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ef0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202d6 expref: 36 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.297967:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ef0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202d6 expref: 36 pid: 6855 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217003.297988:0:5785:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f7a1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1868789733980672:192.168.203.19@tcp:104: 00000100:00100000:1.0:1782217003.298115:0:5785:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64e380e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782217003.305789:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217003.306734:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714026752 00000100:00100000:2.0:1782217003.306749:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714026752 00010000:00010000:2.0:1782217003.306801:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ef0e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202d6 expref: 37 pid: 6855 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217003.306836:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 38 00000100:00100000:2.0:1782217003.306846:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e644799450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+37:2358:x1868789714026752:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217003.306862:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217003.306868:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ef0e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202d6 expref: 37 pid: 6855 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217003.306896:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ef0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202d6 expref: 37 pid: 6855 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217003.306917:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e67a811200) 00010000:00010000:2.0:1782217003.306922:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089ef3f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217003.306932:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089ef3f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217003.306953:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089ef3f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217003.306974:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217003.307030:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e644799450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+37:2358:x1868789714026752:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 185us (1260us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217003.307038:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 38 00010000:00010000:1.0:1782217003.309842:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ef0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202d6 expref: 36 pid: 6855 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217003.309922:0:5785:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f7a1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1868789733980672:192.168.203.19@tcp:104: 00010000:00010000:1.0:1782217003.310028:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089ef3f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.310041:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089ef3f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.310048:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089ef3f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217003.310076:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1782217003.310382:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089ef38 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202e4 expref: 37 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.310413:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089ef3f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202e4 expref: 36 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.310423:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e67a811200) 00010000:00010000:1.0:1782217003.310443:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782217003.310448:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd07200, rc 0) 00000100:00100000:1.0:1782217003.311086:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fcb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+36:10347:x1868789714026624:12345-192.168.203.19@tcp:101:dd.0 Request processed in 13551us (13865us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1782217003.311099:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 51 00000100:00100000:0.0:1782217003.318960:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217003.319126:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714027008 00000100:00100000:2.0:1782217003.319136:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714027008 00000100:00100000:2.0:1782217003.319198:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 52 00000100:00100000:2.0:1782217003.319207:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+36:10347:x1868789714027008:12345-192.168.203.19@tcp:36:dd.0 00010000:00010000:2.0:1782217003.319485:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089ef4d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217003.319503:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089ef4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217003.319514:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089ef4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782217003.319564:0:5783:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1782217003.319589:0:5783:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000795324b9 reply state 00000000b64f0632 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089ef4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217003.319599:0:5783:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782217003.319693:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+39:10347:x1868789714027008:12345-192.168.203.19@tcp:36:dd.0 Request processed in 485us (740us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1782217003.319701:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 52 00000020:00080000:2.0:1782217003.319705:0:5783:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782217003.322317:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089ef4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217003.322335:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089ef4d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217003.322343:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089ef4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217003.322350:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738af400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217003.322354:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089ef4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217003.322373:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089ef4d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217003.322399:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e67a811200) 00010000:00010000:3.0:1782217003.322402:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217003.322423:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089ef4d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217003.322430:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089ef4d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217003.547520:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217003.557909:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714027136 00000100:00100000:3.0:1782217003.557923:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714027136 00000100:00100000:3.0:1782217003.558330:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 53 00000100:00100000:3.0:1782217003.558354:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fcb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+38:10361:x1868789714027136:12345-192.168.203.19@tcp:101:stat.0 00010000:00010000:3.0:1782217003.558379:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217003.558409:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089ef54 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6202eb expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217003.558484:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ef5b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217003.558497:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ef5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217003.558507:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ef5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217003.558521:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089ef62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217003.558527:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089ef62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217003.558533:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089ef62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217003.558640:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089ef69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217003.558651:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089ef3f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202e4 expref: 39 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217003.558659:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089ef69 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217003.558692:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089ef3f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202e4 expref: 39 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217003.558706:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089ef3f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202e4 expref: 39 pid: 5785 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217003.558721:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f62c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5784:1868789733980800:192.168.203.19@tcp:104: 00000100:00100000:3.0:1782217003.558822:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e67f2e5300 going to sleep for 11 seconds 00000100:00100000:3.0:1782217003.563102:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f62c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5784:1868789733980800:192.168.203.19@tcp:104: 00010000:00010000:3.0:1782217003.563141:0:5784:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089ef69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217003.565014:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217003.565660:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714027392 00000100:00100000:3.0:1782217003.565670:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714027392 00000100:00100000:3.0:1782217003.565839:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 13 00000100:00100000:3.0:1782217003.565850:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+40:5569:x1868789714027392:12345-192.168.203.19@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1782217003.566245:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+41:5569:x1868789714027392:12345-192.168.203.19@tcp:35:ldlm_bl.0 Request processed in 396us (1235us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1782217003.566265:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 13 00000100:00100000:0.0:1782217003.571767:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217003.572379:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714027520 00000100:00100000:3.0:1782217003.572399:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714027520 00010000:00010000:3.0:1782217003.572450:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089ef3f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202e4 expref: 41 pid: 5785 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217003.572487:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 39 00000100:00100000:3.0:1782217003.572497:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fcb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+41:2358:x1868789714027520:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217003.572511:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217003.572518:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089ef3f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202e4 expref: 41 pid: 5785 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217003.572531:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089ef3f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202e4 expref: 41 pid: 5785 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217003.572552:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089ef3f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202e4 expref: 41 pid: 5785 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217003.572580:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e67a811200) 00010000:00010000:3.0:1782217003.572585:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089ef69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217003.572601:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089ef69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217003.572610:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089ef69 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217003.572665:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217003.572718:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fcb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+40:2358:x1868789714027520:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 221us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217003.572726:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 39 00010000:00010000:1.0:1782217003.572870:0:5784:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089ef69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.572917:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089ef69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217003.572972:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1782217003.572976:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782217003.573018:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089ef69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.573030:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089ef69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.573040:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ef5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.573046:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ef5b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.573051:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ef5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.573056:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640031e00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217003.573059:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ef5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.573076:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ef5b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.573106:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88e650a64700) 00010000:00010000:1.0:1782217003.573108:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217003.573111:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ef5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.573116:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089ef5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.573335:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089ef62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.573342:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089ef62 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.573347:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089ef62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.573351:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640031600 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217003.573354:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089ef62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.573359:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089ef62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.573368:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88e650a64600) 00010000:00010000:1.0:1782217003.573370:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217003.573372:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089ef62 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.573396:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089ef62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.573434:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089ef54 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202eb expref: 40 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.573729:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089ef69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202eb expref: 39 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.573746:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e67a811200) 00010000:00010000:1.0:1782217003.573748:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782217003.573751:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e640030600, rc 0) 00000100:00100000:1.0:1782217003.573790:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fcb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+39:10361:x1868789714027136:12345-192.168.203.19@tcp:101:stat.0 Request processed in 15439us (26279us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217003.573797:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 53 00010000:00010000:3.0:1782217003.604342:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217003.664821:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217003.664937:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714027776 00000100:00100000:2.0:1782217003.664953:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714027776 00000100:00100000:2.0:1782217003.665039:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 54 00000100:00100000:2.0:1782217003.665050:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fcb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+39:10367:x1868789714027776:12345-192.168.203.19@tcp:36:truncate.0 00010000:00010000:2.0:1782217003.665118:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217003.665152:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089ef69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202eb expref: 39 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217003.665171:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e67a811200) 00010000:00010000:2.0:1782217003.665175:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782217003.665367:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089ef70 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217003.665401:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089ef70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217003.665411:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089ef70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782217003.665455:0:5783:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1782217003.665479:0:5783:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bda7a485 reply state 000000009d98de1e transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089ef70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217003.665488:0:5783:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782217003.665587:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fcb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+41:10367:x1868789714027776:12345-192.168.203.19@tcp:36:truncate.0 Request processed in 539us (780us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1782217003.665605:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 54 00000020:00080000:2.0:1782217003.665609:0:5783:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1782217003.669399:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089ef70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.669418:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089ef70 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.669427:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089ef70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.669435:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738ae200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217003.669439:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089ef70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.669448:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089ef70 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.669479:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e67a811200) 00010000:00010000:1.0:1782217003.669482:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217003.669486:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089ef70 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.669492:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089ef70 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217003.818844:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217003.818986:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714027904 00000100:00100000:1.0:1782217003.818996:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714027904 00000100:00100000:1.0:1782217003.819061:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 55 00000100:00100000:1.0:1782217003.819071:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fcb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+40:10381:x1868789714027904:12345-192.168.203.19@tcp:101:stat.0 00010000:00010000:1.0:1782217003.819098:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217003.819118:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089ef77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6202f2 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.819183:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ef7e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.819198:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ef7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.819211:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ef7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.819224:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ef85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.819230:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ef85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.819253:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ef85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.819349:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089ef8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.819358:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089ef8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.819364:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089ef8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217003.819407:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1782217003.819412:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782217003.819432:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089ef8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.819443:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089ef8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.819450:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ef7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.819456:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ef7e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.819462:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ef7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.819468:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06c00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217003.819472:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ef7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.819486:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ef7e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.819498:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88e650a64700) 00010000:00010000:1.0:1782217003.819501:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217003.819506:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ef7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.819512:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089ef7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.819526:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ef85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.819531:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ef85 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.819538:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ef85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.819544:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07a00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217003.819546:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ef85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.819551:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ef85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.819562:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88e67a811300) 00010000:00010000:1.0:1782217003.819564:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217003.819566:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ef85 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.819580:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089ef85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.819613:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089ef77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202f2 expref: 42 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.819624:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089ef8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202f2 expref: 41 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.819631:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e67a811200) 00010000:00010000:1.0:1782217003.819633:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782217003.819635:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd07e00, rc 0) 00000100:00100000:1.0:1782217003.819694:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fcb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+41:10381:x1868789714027904:12345-192.168.203.19@tcp:101:stat.0 Request processed in 625us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217003.819701:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 55 00000100:00100000:2.0:1782217003.912982:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217003.913136:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714028160 00000100:00100000:0.0:1782217003.913146:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714028160 00000100:00100000:0.0:1782217003.913205:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 56 00000100:00100000:0.0:1782217003.913215:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+41:10390:x1868789714028160:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:0.0:1782217003.913233:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217003.913253:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089ef93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6202f9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217003.913358:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1782217003.913485:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089ef93 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202f9 expref: 43 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217003.913500:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e65417f500) 00010000:00010000:0.0:1782217003.913512:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782217003.913517:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089ef93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202f9 expref: 43 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217003.913531:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437ae00, rc 0) 00000100:00100000:0.0:1782217003.913595:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+42:10390:x1868789714028160:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 381us (623us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1782217003.913602:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 56 00000100:00100000:0.0:1782217003.919317:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217003.919420:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714028416 00000100:00100000:2.0:1782217003.919444:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714028416 00000100:00100000:2.0:1782217003.919499:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 14 00000100:00100000:2.0:1782217003.919510:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+42:10390:x1868789714028416:12345-192.168.203.19@tcp:35:lfs.0 00000100:00100000:2.0:1782217003.919752:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+43:10390:x1868789714028416:12345-192.168.203.19@tcp:35:lfs.0 Request processed in 243us (444us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1782217003.919760:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 14 00000100:00100000:2.0:1782217003.982277:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217003.982361:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714028672 00000100:00100000:1.0:1782217003.982376:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714028672 00000100:00100000:1.0:1782217003.982472:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 57 00000100:00100000:1.0:1782217003.982485:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+43:10397:x1868789714028672:12345-192.168.203.19@tcp:101:bash.0 00010000:00010000:1.0:1782217003.982509:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217003.982529:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089efa1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620300 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.982627:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089efa8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.982642:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089ef8c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202f2 expref: 44 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.982664:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089efa8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.982702:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089ef8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202f2 expref: 44 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.982714:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089ef8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202f2 expref: 44 pid: 5785 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217003.982727:0:5785:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f7a1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1868789733980928:192.168.203.19@tcp:104: 00000100:00100000:1.0:1782217003.982828:0:5785:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64e380840 going to sleep for 11 seconds 00000100:00100000:1.0:1782217003.990004:0:5785:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f7a1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1868789733980928:192.168.203.19@tcp:104: 00010000:00010000:1.0:1782217003.990036:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089efa8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217003.993289:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217003.994222:0:8301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714028800 00000100:00100000:3.0:1782217003.994237:0:8301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714028800 00010000:00010000:3.0:1782217003.994305:0:8301:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089ef8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202f2 expref: 45 pid: 5785 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217003.994371:0:8301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 40 00000100:00100000:3.0:1782217003.994396:0:8301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f190700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:10ba4d21-74e8-42e8-8e52-48a327751cbd+45:2359:x1868789714028800:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217003.994419:0:8301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217003.994428:0:8301:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089ef8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202f2 expref: 45 pid: 5785 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217003.994445:0:8301:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089ef8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202f2 expref: 45 pid: 5785 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217003.994588:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089ef8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202f2 expref: 45 pid: 5785 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217003.994611:0:8301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e67a811200) 00010000:00010000:3.0:1782217003.994618:0:8301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089efa8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217003.994632:0:8301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089efa8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217003.994661:0:8301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089efa8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217003.994698:0:8301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217003.994847:0:8301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f190700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:10ba4d21-74e8-42e8-8e52-48a327751cbd+44:2359:x1868789714028800:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 464us (1571us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217003.994858:0:8301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 40 00010000:00010000:1.0:1782217003.995565:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089efa8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.995581:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089efa8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217003.995606:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1782217003.995776:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089efa1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620300 expref: 45 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.995797:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089efa8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620300 expref: 44 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217003.995835:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e67a811200) 00010000:00010000:1.0:1782217003.995838:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782217003.995842:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd07a00, rc 0) 00000100:00100000:1.0:1782217003.995946:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+44:10397:x1868789714028672:12345-192.168.203.19@tcp:101:bash.0 Request processed in 13459us (13680us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1782217003.995959:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 57 00000100:00100000:0.0:1782217004.002614:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217004.006199:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714029056 00000100:00100000:2.0:1782217004.006221:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714029056 00000100:00100000:2.0:1782217004.009615:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 58 00000100:00100000:2.0:1782217004.009652:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fcb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+44:10397:x1868789714029056:12345-192.168.203.19@tcp:36:bash.0 00010000:00010000:2.0:1782217004.010036:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089efb6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.010058:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089efb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.010072:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089efb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782217004.010138:0:5783:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1782217004.010168:0:5783:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005ab05bbe reply state 00000000dbf2a11d transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089efb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217004.010180:0:5783:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782217004.010318:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fcb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+47:10397:x1868789714029056:12345-192.168.203.19@tcp:36:bash.0 Request processed in 685us (7711us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1782217004.010326:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 58 00000020:00080000:2.0:1782217004.010349:0:5783:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:1.0:1782217004.010465:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782217004.020561:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089efb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.020584:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089efb6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.020592:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089efb6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.020599:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738af600 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217004.020604:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089efb6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.020612:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089efb6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.020633:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e67a811200) 00010000:00010000:3.0:1782217004.020637:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217004.020642:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089efb6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.020648:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089efb6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217004.027352:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217004.028399:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714029184 00000100:00100000:3.0:1782217004.028416:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714029184 00000100:00100000:3.0:1782217004.028495:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 59 00000100:00100000:3.0:1782217004.028506:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fcb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+46:10397:x1868789714029184:12345-192.168.203.19@tcp:101:bash.0 00010000:00010000:3.0:1782217004.028539:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217004.028564:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089efbd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620307 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.028685:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089efc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.028702:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089efa8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620300 expref: 47 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.028712:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089efc4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.028756:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089efa8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620300 expref: 47 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.028771:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089efa8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620300 expref: 47 pid: 5785 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217004.028787:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f62c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5784:1868789733981056:192.168.203.19@tcp:104: 00000100:00100000:3.0:1782217004.028927:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e644494d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782217004.032765:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217004.032817:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217004.032857:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217004.033016:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714029440 00000100:00100000:3.0:1782217004.033028:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714029440 00000100:00100000:3.0:1782217004.033134:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 73 00000100:00100000:3.0:1782217004.033145:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fcb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:2356:x1868789714029440:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:3.0:1782217004.033239:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fcb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:2356:x1868789714029440:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 96us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217004.033247:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 73 00000100:00100000:3.0:1782217004.034353:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f62c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5784:1868789733981056:192.168.203.19@tcp:104: 00010000:00010000:3.0:1782217004.034407:0:5784:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089efc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1782217004.034692:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782217004.035171:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714029568 00000100:00100000:1.0:1782217004.035182:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714029568 00000100:00100000:1.0:1782217004.035276:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 129 00000100:00100000:1.0:1782217004.035288:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2356:x1868789714029568:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:1.0:1782217004.035401:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2356:x1868789714029568:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 114us (2581us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217004.035408:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 129 00000100:00080000:0.0:1782217004.035618:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782217004.035870:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714029312 00000100:00100000:2.0:1782217004.035924:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714029312 00000100:00100000:2.0:1782217004.035966:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 285 00000100:00100000:2.0:1782217004.035974:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2356:x1868789714029312:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:2.0:1782217004.036023:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2356:x1868789714029312:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 50us (3272us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217004.036031:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 285 00000100:00100000:0.0:1782217004.040296:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217004.040500:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714029696 00000100:00100000:2.0:1782217004.040513:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714029696 00010000:00010000:2.0:1782217004.040569:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089efa8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620300 expref: 48 pid: 5785 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217004.040704:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 41 00000100:00100000:2.0:1782217004.040720:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fcb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+48:2358:x1868789714029696:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217004.040741:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217004.040749:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089efa8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620300 expref: 48 pid: 5785 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.040763:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089efa8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620300 expref: 48 pid: 5785 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.040806:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089efa8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620300 expref: 48 pid: 5785 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.040826:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e67a811200) 00010000:00010000:2.0:1782217004.040833:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089efc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.040862:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089efc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.040871:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089efc4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.041055:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217004.041123:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fcb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+47:2358:x1868789714029696:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 406us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217004.041132:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 41 00010000:00010000:1.0:1782217004.041206:0:5784:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089efc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.041215:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089efc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217004.041274:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1782217004.041279:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782217004.041306:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089efc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.041346:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089efbd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620307 expref: 47 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.041399:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089efc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620307 expref: 46 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.041407:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e67a811200) 00010000:00010000:1.0:1782217004.041411:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782217004.041413:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e640030200, rc 0) 00000100:00100000:1.0:1782217004.041443:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fcb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+46:10397:x1868789714029184:12345-192.168.203.19@tcp:101:bash.0 Request processed in 12940us (14109us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217004.041451:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 59 00000100:00100000:1.0:1782217004.045112:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217004.045204:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714029952 00000100:00100000:2.0:1782217004.045217:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714029952 00000100:00100000:2.0:1782217004.045320:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 15 00000100:00100000:2.0:1782217004.045333:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664ed0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+46:10397:x1868789714029952:12345-192.168.203.19@tcp:35:bash.0 00000100:00100000:2.0:1782217004.045678:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664ed0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+47:10397:x1868789714029952:12345-192.168.203.19@tcp:35:bash.0 Request processed in 347us (579us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1782217004.045688:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 15 00000100:00100000:2.0:1782217004.123051:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217004.126948:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714030208 00000100:00100000:0.0:1782217004.126969:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714030208 00000100:00100000:0.0:1782217004.127160:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 60 00000100:00100000:0.0:1782217004.127174:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+47:10407:x1868789714030208:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:0.0:1782217004.127211:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217004.127239:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089efcb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62030e expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217004.127415:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1782217004.127594:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089efcb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62030e expref: 49 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217004.127636:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e65417f500) 00010000:00010000:0.0:1782217004.127639:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782217004.127646:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089efcb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62030e expref: 49 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217004.127677:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437b200, rc 0) 00000100:00100000:0.0:1782217004.127778:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+48:10407:x1868789714030208:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 607us (4742us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1782217004.127787:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 60 00000100:00100000:0.0:1782217004.130321:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217004.131212:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714030336 00000100:00100000:3.0:1782217004.131226:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714030336 00000100:00100000:3.0:1782217004.131483:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 61 00000100:00100000:3.0:1782217004.131498:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fcb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+48:10407:x1868789714030336:12345-192.168.203.19@tcp:34:lfs.0 00010000:00010000:3.0:1782217004.131611:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089efd9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.131631:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089efd9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.131645:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089efd9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.131670:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089efe0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.131678:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089efe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.131684:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089efe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.131847:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089efe7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.131856:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089efe7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.131864:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089efe7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782217004.131970:0:5783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089efe7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.131985:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089efd9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.131992:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089efd9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.132000:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089efd9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.132006:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640031600 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217004.132010:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089efd9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.132018:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089efd9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.132032:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88e650a64700) 00010000:00010000:3.0:1782217004.132036:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217004.132042:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089efd9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.132055:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089efd9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.132071:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089efe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.132076:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089efe0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.132082:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089efe0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.132087:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640031e00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217004.132090:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089efe0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.132096:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089efe0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.132104:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88e650a64f00) 00010000:00010000:3.0:1782217004.132107:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217004.132109:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089efe0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.132114:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089efe0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.132128:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089efe7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.132134:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089efe7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.132146:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089efe7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.132152:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640030600 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217004.132155:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089efe7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.132160:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089efe7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.132168:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e67a811200) 00010000:00010000:3.0:1782217004.132171:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217004.132173:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089efe7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.132179:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089efe7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217004.132277:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fcb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+48:10407:x1868789714030336:12345-192.168.203.19@tcp:34:lfs.0 Request processed in 782us (1980us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217004.136110:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 61 00000100:00100000:3.0:1782217004.139279:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217004.140168:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714030592 00000100:00100000:1.0:1782217004.140184:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714030592 00000100:00100000:2.0:1782217004.140425:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 16 00000100:00100000:2.0:1782217004.140442:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f62c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+48:10407:x1868789714030592:12345-192.168.203.19@tcp:35:lfs.0 00000100:00100000:2.0:1782217004.142366:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f62c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+49:10407:x1868789714030592:12345-192.168.203.19@tcp:35:lfs.0 Request processed in 1915us (3087us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1782217004.142380:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 16 00000100:00100000:2.0:1782217004.197819:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217004.197947:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714030848 00000100:00100000:1.0:1782217004.197962:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714030848 00000100:00100000:1.0:1782217004.198042:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 62 00000100:00100000:1.0:1782217004.198055:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+49:10410:x1868789714030848:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:1.0:1782217004.198091:0:6855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217004.198118:0:6855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07c00/0xf210a9075089efee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620315 expref: -99 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.199111:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089eff5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.199135:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089eff5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.199150:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089eff5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.199423:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089effc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.199433:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089effc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.199441:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089effc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.199614:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f003 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.199624:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f003 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.199631:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f003 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217004.199643:0:6855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1782217004.199768:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089eff5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.199777:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089eff5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.199785:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089eff5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.199791:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217004.199796:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089eff5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.199817:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089eff5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.199831:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88e650a64700) 00010000:00010000:1.0:1782217004.199835:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217004.199841:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089eff5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.199846:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089eff5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.199863:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089effc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.199870:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089effc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.199934:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089effc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.199940:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217004.199943:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089effc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.199949:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089effc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.199957:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88e67a811300) 00010000:00010000:1.0:1782217004.199960:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217004.199962:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089effc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.199978:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089effc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.200036:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07c00/0xf210a9075089efee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620315 expref: 52 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.200051:0:6855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f003 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620315 expref: 51 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.200058:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e67a811200) 00010000:00010000:1.0:1782217004.200060:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782217004.200063:0:6855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd06400, rc 0) 00000100:00100000:1.0:1782217004.200153:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+51:10410:x1868789714030848:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 2101us (2349us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1782217004.200164:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 62 00000100:00100000:0.0:1782217004.205124:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217004.205408:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714030976 00000100:00100000:3.0:1782217004.205422:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714030976 00000100:00100000:3.0:1782217004.205510:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 3 00000100:00100000:3.0:1782217004.205523:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+51:2357:x1868789714030976:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217004.205543:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217004.205576:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f003 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620315 expref: 51 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.205621:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e67a811200) 00010000:00010000:3.0:1782217004.205628:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217004.205700:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+50:2357:x1868789714030976:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 179us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217004.205709:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 3 00000100:00100000:0.0:1782217004.206102:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217004.207740:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714031104 00000100:00100000:1.0:1782217004.207756:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714031104 00000100:00100000:1.0:1782217004.207901:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 63 00000100:00100000:1.0:1782217004.207915:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fcb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+50:10410:x1868789714031104:12345-192.168.203.19@tcp:54:lfs.0 00010000:00010000:1.0:1782217004.208004:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f011 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.208025:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.208037:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.208092:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.208100:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f011 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.208108:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f011 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.208115:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07a00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217004.208120:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f011 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.208128:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f011 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.208142:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e67a811200) 00010000:00010000:1.0:1782217004.208145:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782217004.208150:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f011 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.208156:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f011 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217004.208271:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fcb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+50:10410:x1868789714031104:12345-192.168.203.19@tcp:54:lfs.0 Request processed in 359us (2170us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217004.208280:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 63 00000100:00100000:2.0:1782217004.211054:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217004.211141:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714031360 00000100:00100000:1.0:1782217004.211153:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714031360 00000100:00100000:1.0:1782217004.211335:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 17 00000100:00100000:1.0:1782217004.211433:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f190000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+50:10410:x1868789714031360:12345-192.168.203.19@tcp:35:lfs.0 00000100:00100000:1.0:1782217004.211733:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f190000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+51:10410:x1868789714031360:12345-192.168.203.19@tcp:35:lfs.0 Request processed in 302us (691us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1782217004.211742:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 17 00000100:00100000:0.0:1782217004.355528:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217004.355998:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714031616 00000100:00100000:1.0:1782217004.356011:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714031616 00000100:00100000:1.0:1782217004.356084:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 64 00000100:00100000:1.0:1782217004.356095:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fcb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+51:10428:x1868789714031616:12345-192.168.203.19@tcp:101:cat.0 00010000:00010000:1.0:1782217004.356128:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217004.356156:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f018 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62031c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.356290:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07c00/0xf210a9075089f01f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.356308:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07c00/0xf210a9075089f01f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.356322:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07c00/0xf210a9075089f01f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217004.356336:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1782217004.356507:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f018 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62031c expref: 54 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.356529:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07c00/0xf210a9075089f01f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62031c expref: 53 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.357852:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e67a811200) 00010000:00010000:1.0:1782217004.357856:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1782217004.357861:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd07c00, rc 0) 00000100:00100000:1.0:1782217004.358585:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fcb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+53:10428:x1868789714031616:12345-192.168.203.19@tcp:101:cat.0 Request processed in 1873us (2452us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1782217004.358598:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 64 00000100:00100000:0.0:1782217004.399318:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217004.399665:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714031744 00000100:00100000:3.0:1782217004.399679:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714031744 00000100:00100000:3.0:1782217004.399756:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 65 00000100:00100000:3.0:1782217004.399768:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+53:10429:x1868789714031744:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:3.0:1782217004.399801:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217004.399827:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f02d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620323 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.400249:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089f034 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.400267:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089f034 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.400280:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089f034 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217004.400360:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1782217004.400365:0:5783:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1782217004.400401:0:5783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089f034 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.400432:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f02d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620323 expref: 55 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.400474:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089f034 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620323 expref: 54 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217004.400483:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88e650a64700) 00010000:00010000:3.0:1782217004.400487:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782217004.400491:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e640031e00, rc 0) 00000100:00100000:3.0:1782217004.400682:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+54:10429:x1868789714031744:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 915us (1377us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217004.400692:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 65 00000100:00100000:2.0:1782217004.414528:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217004.414712:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714032128 00000100:00100000:1.0:1782217004.414726:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714032128 00000100:00100000:1.0:1782217004.414809:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 18 00000100:00100000:1.0:1782217004.414822:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+54:10429:x1868789714032128:12345-192.168.203.19@tcp:35:lfs.0 00000100:00100000:1.0:1782217004.415504:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+55:10429:x1868789714032128:12345-192.168.203.19@tcp:35:lfs.0 Request processed in 681us (991us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1782217004.415515:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 18 00000100:00100000:0.0:1782217004.426431:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217004.428464:0:8300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714032256 00000100:00100000:1.0:1782217004.428486:0:8300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714032256 00000100:00100000:1.0:1782217004.428596:0:8300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 4 00000100:00100000:1.0:1782217004.428609:0:8300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+55:10429:x1868789714032256:12345-192.168.203.19@tcp:103:lfs.0 00010000:00010000:1.0:1782217004.428632:0:8300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1782217004.428666:0:8300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089efc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620307 expref: 55 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.428697:0:8300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07c00/0xf210a9075089f01f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62031c expref: 54 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.428712:0:8300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089eecf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6202c8 expref: 53 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.428742:0:8300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e67a811200) 00010000:00010000:1.0:1782217004.429686:0:8300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782217004.430318:0:8300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+52:10429:x1868789714032256:12345-192.168.203.19@tcp:103:lfs.0 Request processed in 1702us (3897us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217004.430333:0:8300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 4 00000100:00100000:0.0:1782217004.450633:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217004.450734:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714032384 00000100:00100000:1.0:1782217004.450748:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714032384 00000100:00100000:1.0:1782217004.450826:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 66 00000100:00100000:1.0:1782217004.450846:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+52:10429:x1868789714032384:12345-192.168.203.19@tcp:58:lfs.0 00010000:00010000:1.0:1782217004.451036:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f03b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.451058:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f03b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.451072:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f03b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782217004.451420:0:6855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782217004.451662:0:6855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1782217004.451725:0:6855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1782217004.451873:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+52:10429:x1868789714032384:12345-192.168.203.19@tcp:58:lfs.0 Request processed in 1026us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217004.451934:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 66 00000100:00100000:3.0:1782217004.473283:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217004.473430:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714032512 00000100:00100000:1.0:1782217004.473444:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714032512 00000100:00100000:1.0:1782217004.473644:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 67 00000100:00100000:1.0:1782217004.473659:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f62df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+52:10431:x1868789714032512:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:1.0:1782217004.473707:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217004.473734:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07c00/0xf210a9075089f042 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62032a expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.473818:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f049 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.473835:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f049 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.473863:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f049 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.474752:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f050 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.474771:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f050 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.474781:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f050 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.475005:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f057 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.475017:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f057 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.475024:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f057 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217004.475076:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1782217004.475094:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782217004.475125:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f057 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.475138:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f057 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.475147:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f049 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.475153:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f049 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.475160:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f049 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.475166:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07a00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217004.475170:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f049 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.475178:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f049 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.475193:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88e650a64700) 00010000:00010000:1.0:1782217004.475197:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217004.475202:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f049 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.475209:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f049 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.475225:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f050 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.475242:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f050 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.475248:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f050 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.475253:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217004.475257:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f050 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.475263:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f050 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.475272:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88e67a811300) 00010000:00010000:1.0:1782217004.475275:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217004.475278:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f050 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.475285:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f050 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.475332:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07c00/0xf210a9075089f042 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62032a expref: 54 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.475348:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f057 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62032a expref: 53 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.475356:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e67a811200) 00010000:00010000:1.0:1782217004.475359:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782217004.475368:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd06200, rc 0) 00000100:00100000:1.0:1782217004.479147:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f62df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+53:10431:x1868789714032512:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 5471us (5861us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217004.479165:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 67 00000040:00080000:3.0:1782217004.500283:0:11532:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782217004.500295:0:11532:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782217004.500351:0:11532:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1782217004.500362:0:11532:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782217004.501260:0:11532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664484e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11532:1868789733981184:192.168.203.19@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782217004.501410:0:11532:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e644494240 going to sleep for 11 seconds 00000100:00100000:3.0:1782217004.517915:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217004.518007:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714032640 00000100:00100000:1.0:1782217004.518018:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714032640 00000100:00100000:1.0:1782217004.518093:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 1 00000100:00100000:1.0:1782217004.518116:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:10ba4d21-74e8-42e8-8e52-48a327751cbd+54:10434:x1868789714032640:12345-192.168.203.19@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1782217004.518449:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:10ba4d21-74e8-42e8-8e52-48a327751cbd+54:10434:x1868789714032640:12345-192.168.203.19@tcp:900:lhsmtool_posix.0 Request processed in 335us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217004.518457:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 1 00000100:00100000:0.0:1782217004.519506:0:11532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664484e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11532:1868789733981184:192.168.203.19@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1782217004.525972:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217004.526121:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714032768 00000100:00100000:1.0:1782217004.526136:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714032768 00000100:00100000:1.0:1782217004.526218:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 68 00000100:00100000:1.0:1782217004.526230:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+53:10434:x1868789714032768:12345-192.168.203.19@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1782217004.526277:0:6855:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1782217004.526456:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+53:10434:x1868789714032768:12345-192.168.203.19@tcp:53:lhsmtool_posix.0 Request processed in 227us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217004.526466:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 68 00000100:00100000:2.0:1782217004.537932:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217004.541745:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714032896 00000100:00100000:3.0:1782217004.541768:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714032896 00000100:00100000:2.0:1782217004.542492:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 69 00000100:00100000:2.0:1782217004.542508:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+53:10434:x1868789714032896:12345-192.168.203.19@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1782217004.542630:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f05e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.542652:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f05e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.542666:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f05e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.542684:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089f065 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.542692:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089f065 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.542699:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089f065 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.542731:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae400/0xf210a9075089f06c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.542740:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae400/0xf210a9075089f06c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.542747:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae400/0xf210a9075089f06c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217004.542796:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1782217004.542802:0:5783:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782217004.542840:0:5783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae400/0xf210a9075089f06c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.542866:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f05e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.542873:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f05e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.542920:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f05e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.542927:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738af200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217004.542932:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f05e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.542939:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f05e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.542961:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88e67a811700) 00010000:00010000:2.0:1782217004.542964:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217004.542969:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f05e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.542975:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f05e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.543408:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089f065 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.543419:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089f065 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.543425:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089f065 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.543440:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738aec00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217004.543443:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089f065 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.543450:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089f065 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.543460:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff88e65417f100) 00010000:00010000:2.0:1782217004.543463:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217004.543466:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089f065 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.543473:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089f065 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.543491:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae400/0xf210a9075089f06c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.543497:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae400/0xf210a9075089f06c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.543502:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae400/0xf210a9075089f06c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.543507:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738ae400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217004.543510:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae400/0xf210a9075089f06c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.543613:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae400/0xf210a9075089f06c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.543637:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e67a811200) 00010000:00010000:2.0:1782217004.543640:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217004.543643:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae400/0xf210a9075089f06c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.543649:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae400/0xf210a9075089f06c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217004.543770:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+53:10434:x1868789714032896:12345-192.168.203.19@tcp:34:lhsmtool_posix.0 Request processed in 1261us (5886us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217004.543781:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 69 00000100:00100000:3.0:1782217004.555272:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217004.555498:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714033152 00000100:00100000:1.0:1782217004.555512:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714033152 00000100:00100000:1.0:1782217004.555713:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 70 00000100:00100000:1.0:1782217004.555726:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+53:10434:x1868789714033152:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782217004.555756:0:6855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217004.555783:0:6855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07c00/0xf210a9075089f073 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620331 expref: -99 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.558341:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f07a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.558369:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f07a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.558396:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f07a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217004.558412:0:6855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1782217004.560304:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f07a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.560326:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f07a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.560335:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f07a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.560342:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217004.560348:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f07a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.560357:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f07a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.560378:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e67a811200) 00010000:00010000:1.0:1782217004.560395:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782217004.560402:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f07a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.560434:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f07a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.562258:0:6855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07c00/0xf210a9075089f073 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620331 expref: 55 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.562283:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88e67a811700) 00010000:00010000:1.0:1782217004.562286:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782217004.562292:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07c00/0xf210a9075089f073 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620331 expref: 55 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.562308:0:6855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd07c00, rc 0) 00000100:00100000:1.0:1782217004.562425:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+54:10434:x1868789714033152:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 6700us (7168us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1782217004.562437:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 70 00000100:00100000:0.0:1782217004.568413:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217004.568682:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714033280 00000100:00100000:1.0:1782217004.568696:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714033280 00000100:00100000:1.0:1782217004.568819:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 71 00000100:00100000:1.0:1782217004.568831:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+54:10434:x1868789714033280:12345-192.168.203.19@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1782217004.568965:0:5784:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1782217004.569115:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+54:10434:x1868789714033280:12345-192.168.203.19@tcp:53:lhsmtool_posix.0 Request processed in 284us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217004.569124:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 71 00000100:00100000:2.0:1782217004.599832:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217004.600131:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714033536 00000100:00100000:0.0:1782217004.600157:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714033536 00000100:00100000:0.0:1782217004.600251:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 72 00000100:00100000:0.0:1782217004.600264:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+54:10434:x1868789714033536:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782217004.600320:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217004.600333:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1782217004.600419:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089f034 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620323 expref: 54 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217004.600455:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88e650a64700) 00010000:00010000:0.0:1782217004.600462:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782217004.600495:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089f088 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620338 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782217004.601250:0:5785:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1782217004.601656:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f08f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217004.601690:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f08f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217004.601703:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f08f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217004.601792:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089f088 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620338 expref: 56 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217004.601815:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f08f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620338 expref: 55 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217004.601826:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88e647d05700) 00010000:00010000:0.0:1782217004.601830:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782217004.601834:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437b200, rc 0) 00000100:00100000:0.0:1782217004.602044:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+55:10434:x1868789714033536:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 1780us (2226us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1782217004.602095:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 72 00000100:00100000:3.0:1782217004.604556:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217004.604646:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714033792 00000100:00100000:2.0:1782217004.604662:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714033792 00000100:00100000:2.0:1782217004.604743:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 73 00000100:00100000:2.0:1782217004.604757:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+55:10434:x1868789714033792:12345-192.168.203.19@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782217004.604850:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217004.605002:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f08f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620338 expref: 55 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.605044:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88e647d05700) 00010000:00010000:2.0:1782217004.605071:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782217004.605132:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089f09d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.605175:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089f09d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.605211:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089f09d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.612600:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f0a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x9929a211 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.612624:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f0a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9929a211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.612637:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f0a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9929a211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.612724:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089f09d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.612732:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089f09d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.612739:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089f09d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.612746:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738aec00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217004.612750:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089f09d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.612758:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089f09d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.612771:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88e650a64700) 00010000:00010000:2.0:1782217004.612774:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217004.612780:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089f09d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.612801:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089f09d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.612815:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f0a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9929a211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.612822:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f0a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9929a211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.612828:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f0a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9929a211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.612833:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738af200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217004.612836:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f0a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9929a211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.612842:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f0a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9929a211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.612850:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x9929a211 (ffff88e65417f100) 00010000:00010000:2.0:1782217004.612852:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217004.612855:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f0a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9929a211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.612861:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f0a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9929a211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217004.612977:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+54:10434:x1868789714033792:12345-192.168.203.19@tcp:36:lhsmtool_posix.0 Request processed in 8219us (8432us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782217004.612987:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 73 00000100:00100000:3.0:1782217004.616417:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217004.616663:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714033920 00000100:00100000:0.0:1782217004.616677:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714033920 00000100:00100000:0.0:1782217004.616753:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 74 00000100:00100000:0.0:1782217004.616766:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+54:10434:x1868789714033920:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782217004.616792:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217004.616822:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f0ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62033f expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217004.617145:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a9075089f0b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217004.617165:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a9075089f0b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217004.617179:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a9075089f0b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217004.617368:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f0ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62033f expref: 56 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217004.617402:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a9075089f0b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62033f expref: 55 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217004.617411:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88e647d05100) 00010000:00010000:0.0:1782217004.617414:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782217004.617418:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437ac00, rc 0) 00000100:00100000:0.0:1782217004.617554:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+55:10434:x1868789714033920:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 790us (1152us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217004.617571:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 74 00000100:00100000:0.0:1782217004.624343:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217004.624465:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714034176 00000100:00100000:1.0:1782217004.624478:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714034176 00000100:00100000:1.0:1782217004.624552:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 75 00000100:00100000:1.0:1782217004.624580:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+55:10434:x1868789714034176:12345-192.168.203.19@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782217004.624704:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07c00/0xf210a9075089f0b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.624726:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07c00/0xf210a9075089f0b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.624739:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07c00/0xf210a9075089f0b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782217004.625201:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1782217004.625215:0:5784:0:(osp_sync.c:1862:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 323677336568ns, next at 324677333675ns, rc = 0 00000004:00010000:1.0:1782217004.625325:0:5784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005a3f0189 reply state 000000000cb618cc transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07c00/0xf210a9075089f0b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217004.625337:0:5784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782217004.625470:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+57:10434:x1868789714034176:12345-192.168.203.19@tcp:36:lhsmtool_posix.0 Request processed in 890us (1140us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1782217004.625479:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 75 00010000:00010000:2.0:1782217004.629123:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217004.631467:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217004.631828:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714034304 00000100:00100000:2.0:1782217004.631842:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714034304 00000100:00100000:2.0:1782217004.631958:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 76 00000100:00100000:2.0:1782217004.631971:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+57:10434:x1868789714034304:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782217004.632002:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217004.632030:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f0c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620346 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.632107:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f0c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620346 expref: 58 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.632125:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f0c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620346 expref: 58 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.632150:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88e647d05100) 00010000:00010000:2.0:1782217004.632153:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782217004.632158:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738af200, rc 0) 00000100:00100000:2.0:1782217004.632244:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+58:10434:x1868789714034304:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 275us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217004.632252:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 76 00010000:00010000:1.0:1782217004.637847:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07c00/0xf210a9075089f0b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.637908:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07c00/0xf210a9075089f0b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.637917:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07c00/0xf210a9075089f0b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.637925:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07c00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217004.637931:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07c00/0xf210a9075089f0b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.637950:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07c00/0xf210a9075089f0b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.637974:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88e647d05100) 00010000:00010000:1.0:1782217004.637978:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782217004.637984:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07c00/0xf210a9075089f0b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217004.637991:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07c00/0xf210a9075089f0b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217004.641583:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217004.641862:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714034432 00000100:00100000:2.0:1782217004.641899:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714034432 00000100:00100000:2.0:1782217004.641951:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 25 00000100:00100000:2.0:1782217004.641963:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1868789714034432:12345-192.168.203.19@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1782217004.642005:0:6580:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 10ba4d21-74e8-42e8-8e52-48a327751cbd@192.168.203.19@tcp t0 exp 0000000000000000 cur 323 last 0 00000020:00000080:2.0:1782217004.642355:0:6580:0:(genops.c:1406:class_connect()) connect: client 10ba4d21-74e8-42e8-8e52-48a327751cbd, cookie 0xf210a9075089f0c7 00002000:00100000:2.0:1782217004.642378:0:6580:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 10ba4d21-74e8-42e8-8e52-48a327751cbd/ffff88e67f5d9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782217004.642418:0:6580:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782217004.642835:0:6580:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1782217004.643072:0:6580:0:(import.c:65:import_set_state_nolock()) ffff88e6738d7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782217004.643166:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2355:x1868789714034432:12345-192.168.203.19@tcp:8:lhsmtool_posix.0 Request processed in 1202us (1598us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217004.643178:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 25 00000100:00100000:0.0:1782217004.653632:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217004.653726:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714034560 00000100:00100000:2.0:1782217004.653744:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714034560 00000100:00100000:2.0:1782217004.653841:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 26 00000100:00080000:1.0:1782217004.653967:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782217004.654018:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:0:x1868789714034560:12345-192.168.203.19@tcp:2:lhsmtool_posix.0 00000001:00080000:1.0:1782217004.751208:0:7488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:1.0:1782217004.751225:0:7488:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 10ba4d21-74e8-42e8-8e52-48a327751cbd 00000100:00100000:1.0:1782217004.751342:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:0:x1868789714034560:12345-192.168.203.19@tcp:2:lhsmtool_posix.0 Request processed in 97485us (97716us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1782217004.751352:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 26 00000100:00100000:0.0:1782217004.760792:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217004.761092:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714034816 00000100:00100000:1.0:1782217004.761106:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714034816 00000100:00100000:1.0:1782217004.761171:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 19 00000100:00100000:1.0:1782217004.761181:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+57:10434:x1868789714034816:12345-192.168.203.19@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1782217004.761644:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+58:10434:x1868789714034816:12345-192.168.203.19@tcp:35:lhsmtool_posix.0 Request processed in 463us (866us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1782217004.761652:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 19 00000100:00100000:1.0:1782217004.777550:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217004.777640:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714035072 00000100:00100000:2.0:1782217004.777656:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714035072 00000100:00100000:2.0:1782217004.777744:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 77 00000100:00100000:2.0:1782217004.777756:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f7a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+58:10434:x1868789714035072:12345-192.168.203.19@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1782217004.777918:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f7a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+58:10434:x1868789714035072:12345-192.168.203.19@tcp:57:lhsmtool_posix.0 Request processed in 164us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217004.777925:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 77 00000100:00100000:0.0:1782217004.782143:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217004.782231:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714035200 00000100:00100000:2.0:1782217004.782244:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714035200 00000100:00100000:2.0:1782217004.782316:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 78 00000100:00100000:2.0:1782217004.782329:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+58:10434:x1868789714035200:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782217004.782356:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217004.782390:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afe00/0xf210a9075089f0ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62034d expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.782500:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089f0d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.782518:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089f0d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.782532:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089f0d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217004.782588:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782217004.782621:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089f0d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.782653:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afe00/0xf210a9075089f0ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62034d expref: 60 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.782672:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089f0d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62034d expref: 59 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.782681:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88e647d05100) 00010000:00010000:2.0:1782217004.782684:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1782217004.782689:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738afa00, rc 0) 00000100:00100000:2.0:1782217004.782769:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+59:10434:x1868789714035200:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 442us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217004.782777:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 78 00000100:00100000:1.0:1782217004.791340:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217004.791532:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714035328 00000100:00100000:2.0:1782217004.791542:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714035328 00000100:00100000:2.0:1782217004.791598:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 27 00000100:00100000:2.0:1782217004.791622:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f7a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2356:x1868789714035328:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782217004.791639:0:7991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217004.791661:0:7991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a167e1b/0xf210a9075089f0dc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620354 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782217004.791687:0:7991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3a792b, blocks: 0x1 00010000:00010000:2.0:1782217004.791709:0:7991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=323s v=(0 0) 00010000:00010000:2.0:1782217004.791713:0:7991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217004.791723:0:7991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a167e1b/0xf210a9075089f0dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620354 expref: 6 pid: 7991 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.791744:0:7991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007a167e1b/0xf210a9075089f0dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620354 expref: 6 pid: 7991 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.791756:0:7991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738ae600, rc 0) 00000100:00100000:2.0:1782217004.791807:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f7a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2356:x1868789714035328:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 188us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217004.791814:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 27 00000100:00100000:1.0:1782217004.796745:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217004.797706:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714035584 00000100:00100000:3.0:1782217004.797717:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714035584 00000100:00100000:3.0:1782217004.797772:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 79 00000100:00100000:3.0:1782217004.797788:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f7a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+59:10434:x1868789714035584:12345-192.168.203.19@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1782217004.806335:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f7a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+59:10434:x1868789714035584:12345-192.168.203.19@tcp:57:lhsmtool_posix.0 Request processed in 8536us (9587us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217004.806352:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 79 00000100:00100000:0.0:1782217004.813107:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217004.813502:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714035712 00000100:00100000:2.0:1782217004.813512:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714035712 00000100:00100000:2.0:1782217004.814592:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 28 00000100:00100000:2.0:1782217004.814608:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:10434:x1868789714035712:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782217004.814627:0:6578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217004.814645:0:6578:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b6373d3/0xf210a9075089f0e3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62035b expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.814688:0:6578:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007a167e1b/0xf210a9075089f0dc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620354 expref: 7 pid: 7991 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.814697:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217004.814701:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217004.814705:0:6578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b6373d3/0xf210a9075089f0e3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62035b expref: 7 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.814737:0:6578:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007a167e1b/0xf210a9075089f0dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620354 expref: 7 pid: 7991 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.814752:0:6578:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007a167e1b/0xf210a9075089f0dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620354 expref: 7 pid: 7991 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217004.814766:0:6578:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f193100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6578:1868789733981312:192.168.203.19@tcp:104: 00000100:00100000:2.0:1782217004.814850:0:6578:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e68058dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1782217004.825126:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217004.825162:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714035840 00000100:00100000:0.0:1782217004.825169:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714035840 00010000:00010000:0.0:1782217004.825208:0:8299:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007a167e1b/0xf210a9075089f0dc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620354 expref: 8 pid: 7991 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217004.825243:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 42 00000100:00100000:0.0:1782217004.825252:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+8:2358:x1868789714035840:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217004.825265:0:8299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217004.825286:0:8299:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007a167e1b/0xf210a9075089f0dc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620354 expref: 8 pid: 7991 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217004.825298:0:8299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007a167e1b/0xf210a9075089f0dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620354 expref: 8 pid: 7991 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217004.825323:0:8299:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217004.825327:0:8299:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217004.825335:0:8299:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006b6373d3/0xf210a9075089f0e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62035b expref: 8 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217004.825846:0:8299:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b6373d3/0xf210a9075089f0e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62035b expref: 8 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217004.825924:0:8299:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006b6373d3/0xf210a9075089f0e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62035b expref: 8 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217004.825940:0:8299:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8299:1868789733981440:192.168.203.19@tcp:105: 00000100:00100000:0.0:1782217004.826010:0:8299:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6445a00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782217004.828285:0:8299:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8299:1868789733981440:192.168.203.19@tcp:105: 00010000:00010000:3.0:1782217004.828310:0:8299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782217004.828522:0:6578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a167e1b/0xf210a9075089f0dc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620354 expref: 8 pid: 7991 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217004.828540:0:6578:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f193100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6578:1868789733981312:192.168.203.19@tcp:104: 00010000:00010000:2.0:1782217004.828559:0:6578:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006b6373d3/0xf210a9075089f0e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62035b expref: 7 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.828572:0:6578:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738ae800, rc 0) 00000100:00100000:3.0:1782217004.828626:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:2358:x1868789714035840:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 3374us (3508us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217004.828637:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 42 00000100:00100000:2.0:1782217004.828712:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:10434:x1868789714035712:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 14109us (15614us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217004.828721:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 28 00000100:00100000:0.0:1782217004.838548:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217004.838591:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714035968 00000100:00100000:0.0:1782217004.838600:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714035968 00002000:00100000:0.0:1782217004.838643:0:6585:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff88e64e2a1c00 x1868789714035968/t0(0) o4->10ba4d21-74e8-42e8-8e52-48a327751cbd@192.168.203.19@tcp:255/0 lens 504/0 e 0 to 0 dl 1782217015 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782217004.838665:0:6585:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff88e64e2a1c00 with x1868789714035968 ext(0->8) 00002000:00010000:0.0:1782217004.838672:0:6585:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88e64e2a1c00 00000100:00100000:0.0:1782217004.838698:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 0 00000100:00100000:0.0:1782217004.838707:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2359:x1868789714035968:12345-192.168.203.19@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1782217004.844059:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+8:2359:x1868789714035968:12345-192.168.203.19@tcp:4:lhsmtool_posix.0 Request processed in 5342us (5508us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1782217004.844074:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 0 00002000:00100000:0.0:1782217004.844086:0:6585:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff88e64e2a1c00 x1868789714035968/t4294967302(0) o4->10ba4d21-74e8-42e8-8e52-48a327751cbd@192.168.203.19@tcp:255/0 lens 504/448 e 0 to 0 dl 1782217015 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782217004.844096:0:6585:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff88e64e2a1c00 with x1868789714035968 ext(0->8) 00002000:00010000:0.0:1782217004.844112:0:6585:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88e64e2a1c00 00000100:00100000:0.0:1782217004.847069:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217004.847153:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714036096 00000100:00100000:2.0:1782217004.847163:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714036096 00000100:00100000:2.0:1782217004.847218:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 80 00000100:00100000:2.0:1782217004.847228:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+59:10434:x1868789714036096:12345-192.168.203.19@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1782217004.900262:0:5805:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000001:00080000:0.0:1782217004.900323:0:5805:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:0.0:1782217004.900333:0:5805:0:(osp_sync.c:1827:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:0.0:1782217004.900462:0:5805:0:(osp_sync.c:1827:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:0.0:1782217004.900492:0:5805:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88e67f2e5c00 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1782217004.900499:0:5805:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff88e679fc3a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88e67f2e5d80 00000020:00080000:0.0:1782217004.900503:0:5805:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff88e679fc3000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88e67aabbc00 00000020:00080000:0.0:1782217004.900525:0:5817:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1782217004.900998:0:5817:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1782217004.901263:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782217004.901285:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733981568:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1782217004.901353:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217004.902538:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+13:10434:x1868789714036096:12345-192.168.203.19@tcp:44:lhsmtool_posix.0 Request processed in 55304us (55471us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217004.902551:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 80 00000100:00100000:2.0:1782217004.902587:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733981568 00000100:00100000:2.0:1782217004.902593:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733981568 00000100:00100000:2.0:1782217004.902636:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782217004.902643:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664487800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733981568:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1782217004.902795:0:7991:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1782217004.902799:0:7991:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1782217004 00002000:00010000:2.0:1782217004.902801:0:7991:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1782217004.902803:0:7991:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1782217003 -> 1782217004 00002000:00010000:2.0:1782217004.902805:0:7991:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1782217004.902846:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664487800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3301:x1868789733981568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 203us (1493us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1782217004.902852:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782217004.902872:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733981696:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782217004.902928:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782217004.902961:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782217004.902972:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733981696 00000100:00100000:2.0:1782217004.902983:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733981696 00000100:00100000:2.0:1782217004.903026:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782217004.903033:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f193100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1868789733981696:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782217004.903048:0:6580:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1782217004.903075:0:6580:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a3a7929, atime: 0x6a3a7929, ctime: 0x6a3a7929, blocks: 0x1 00010000:00010000:2.0:1782217004.903084:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a167e1b/0xf210a9075089f0ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.903099:0:6580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=323s v=(0 0) 00010000:00010000:2.0:1782217004.903102:0:6580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217004.903109:0:6580:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a167e1b/0xf210a9075089f0ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.903127:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a167e1b/0xf210a9075089f0ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.903137:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a167e1b/0xf210a9075089f0ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.903145:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a167e1b/0xf210a9075089f0ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.903164:0:6580:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782217004.903684:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f193100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3303:x1868789733981696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 649us (754us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1782217004.903692:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000004:00080000:2.0:1782217004.903732:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88e664487480/2, rc 0, transno 4294967303 00000100:00100000:2.0:1782217004.903744:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733981568:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1782217004.903767:0:11514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782217004.903773:0:11514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a167e1b/0xf210a9075089f0ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.903782:0:11514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738ae600 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:2.0:1782217004.903787:0:11514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a167e1b/0xf210a9075089f0ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.903797:0:11514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a167e1b/0xf210a9075089f0ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.903813:0:11514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a167e1b/0xf210a9075089f0ea lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.903821:0:11514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a167e1b/0xf210a9075089f0ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217004.903836:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217004.903838:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217004.903840:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782217004.903913:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1782217004.903930:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88e64e2a3480/2, rc 0, transno 4294967301 00000100:00100000:2.0:1782217004.903935:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733981696:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782217004.922589:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217004.923526:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714036224 00000100:00100000:3.0:1782217004.923538:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714036224 00000100:00100000:2.0:1782217004.923665:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 31 00000100:00100000:2.0:1782217004.923678:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f191f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+8:2359:x1868789714036224:12345-192.168.203.19@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1782217005.012751:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e649192a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1868789733982208:0@lo:400:kworker.0 00000100:00100000:3.0:1782217005.012752:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f7a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733981824:0@lo:400:kworker.0 00000100:00100000:3.0:1782217005.012870:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217005.012871:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217005.013095:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e649191500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1868789733982336:0@lo:400:kworker.0 00000100:00100000:3.0:1782217005.013130:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217005.013173:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733982208 00000100:00100000:3.0:1782217005.013182:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733982208 00000100:00100000:3.0:1782217005.013237:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733982336 00000100:00100000:3.0:1782217005.013240:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733982336 00000100:00100000:3.0:1782217005.013262:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1782217005.013270:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649192680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868789733982208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217005.013330:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649192680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868789733982208:12345-0@lo:400:kworker.0 Request processed in 60us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217005.013353:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1782217005.013369:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1782217005.013385:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868789733982336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217005.013425:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868789733982336:12345-0@lo:400:kworker.0 Request processed in 49us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217005.013431:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1782217005.013466:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e649191500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1868789733982336:0@lo:400:kworker.0 00000100:00100000:1.0:1782217005.013584:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e649192a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1868789733982208:0@lo:400:kworker.0 00000100:00080000:2.0:1782217005.013626:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782217005.015102:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f7a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733982080:0@lo:400:kworker.0 00000100:00100000:2.0:1782217005.015158:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217005.015194:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1782217005.015201:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f7a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1868789733981952:0@lo:400:kworker.0 00000100:00100000:2.0:1782217005.015222:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217005.015236:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e649191180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733982464:0@lo:400:kworker.0 00000100:00100000:2.0:1782217005.015257:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217005.015286:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733982080 00000100:00100000:2.0:1782217005.015410:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733982080 00000100:00100000:2.0:1782217005.015452:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733982464 00000100:00100000:2.0:1782217005.015455:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733982464 00000100:00100000:2.0:1782217005.015469:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1782217005.015476:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f190a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3302:x1868789733982080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217005.015523:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f190a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3302:x1868789733982080:12345-0@lo:400:kworker.0 Request processed in 47us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217005.015531:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1782217005.015545:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1782217005.015551:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1868789733982464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217005.015576:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1868789733982464:12345-0@lo:400:kworker.0 Request processed in 26us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217005.015582:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1782217005.015620:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e649191180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733982464:0@lo:400:kworker.0 00000100:00100000:2.0:1782217005.015631:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f7a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733982080:0@lo:400:kworker.0 00000100:00100000:3.0:1782217005.015760:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733981952 00000100:00100000:3.0:1782217005.015765:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733981952 00000100:00100000:3.0:1782217005.015792:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1782217005.015799:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1868789733981952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217005.015837:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1868789733981952:12345-0@lo:400:kworker.0 Request processed in 39us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217005.015843:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1782217005.016013:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f7a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1868789733981952:0@lo:400:kworker.0 00000100:00100000:1.0:1782217005.019030:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733981824 00000100:00100000:1.0:1782217005.019054:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733981824 00000100:00100000:1.0:1782217005.019135:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1782217005.019148:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+19:3304:x1868789733981824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217005.019280:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+19:3304:x1868789733981824:12345-0@lo:400:kworker.0 Request processed in 133us (6414us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217005.019289:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1782217005.019371:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f7a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733981824:0@lo:400:kworker.0 00000100:00100000:2.0:1782217005.034156:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f191f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+8:2359:x1868789714036224:12345-192.168.203.19@tcp:16:lhsmtool_posix.0 Request processed in 110470us (111563us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217005.034171:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 31 00000001:00080000:2.0:1782217005.035024:0:7488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:2.0:1782217005.035048:0:7488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:2.0:1782217005.041439:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217005.041521:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714036480 00000100:00100000:3.0:1782217005.041531:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714036480 00000100:00100000:3.0:1782217005.041591:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 81 00000100:00100000:3.0:1782217005.041601:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f7a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+13:10434:x1868789714036480:12345-192.168.203.19@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782217005.041649:0:6855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217005.041678:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089f0d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62034d expref: 13 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.041696:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88e647d05100) 00010000:00010000:3.0:1782217005.041702:0:6855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782217005.041728:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f0f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.041752:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f0f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.041762:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f0f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782217005.042033:0:6855:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000046724629 reply state 00000000764d630c transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f0f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217005.042043:0:6855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782217005.042139:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f7a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+14:10434:x1868789714036480:12345-192.168.203.19@tcp:36:lhsmtool_posix.0 Request processed in 540us (709us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1782217005.042147:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 81 00010000:00010000:3.0:1782217005.044195:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f0f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.044210:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f0f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.044218:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f0f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.044224:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640030600 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217005.044230:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f0f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.044238:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f0f1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.044253:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88e647d05100) 00010000:00010000:3.0:1782217005.044265:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217005.044271:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f0f1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.044277:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f0f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217005.046234:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217005.046325:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714036608 00000100:00100000:0.0:1782217005.046334:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714036608 00000100:00100000:0.0:1782217005.046400:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 32 00000100:00100000:0.0:1782217005.046409:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f7a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2358:x1868789714036608:12345-192.168.203.19@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1782217005.046646:0:6579:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1782217005.046650:0:6579:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1782217004 -> 1782217003 00002000:00010000:0.0:1782217005.046653:0:6579:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1782217001 00002000:00010000:0.0:1782217005.046662:0:6579:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1782217004 -> 1782217003 00002000:00010000:0.0:1782217005.046665:0:6579:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1782217005.046723:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f7a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:2358:x1868789714036608:12345-192.168.203.19@tcp:2:lhsmtool_posix.0 Request processed in 314us (504us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1782217005.046731:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 32 00000100:00100000:0.0:1782217005.054755:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217005.056509:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714036864 00000100:00100000:1.0:1782217005.056532:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714036864 00000100:00100000:1.0:1782217005.056639:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 82 00000100:00100000:1.0:1782217005.056656:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+13:10434:x1868789714036864:12345-192.168.203.19@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1782217005.056765:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f0f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217005.056789:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a9075089f0b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62033f expref: 13 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217005.056800:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f0f8 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217005.056849:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a9075089f0b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62033f expref: 13 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217005.056910:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a9075089f0b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62033f expref: 13 pid: 5785 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217005.056928:0:5785:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e649192a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1868789733982592:192.168.203.19@tcp:104: 00000100:00100000:1.0:1782217005.057041:0:5785:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64e380300 going to sleep for 11 seconds 00000100:00100000:0.0:1782217005.062011:0:5785:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e649192a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1868789733982592:192.168.203.19@tcp:104: 00010000:00010000:0.0:1782217005.062045:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f0f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217005.073171:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217005.073268:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714036992 00000100:00100000:3.0:1782217005.073278:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714036992 00010000:00010000:3.0:1782217005.073317:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a9075089f0b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62033f expref: 14 pid: 5785 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217005.073383:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 43 00000100:00100000:3.0:1782217005.073397:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e644798c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+14:2358:x1868789714036992:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217005.073415:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217005.073423:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a9075089f0b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62033f expref: 14 pid: 5785 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.073439:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a9075089f0b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62033f expref: 14 pid: 5785 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.073463:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a9075089f0b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62033f expref: 14 pid: 5785 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.073477:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88e647d05100) 00010000:00010000:3.0:1782217005.073482:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f0f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.073490:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f0f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.073505:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f0f8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.073535:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217005.073585:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e644798c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+13:2358:x1868789714036992:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 190us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217005.073594:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 43 00010000:00010000:0.0:1782217005.074282:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f0f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.074292:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f0f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.074320:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f0f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.074328:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f0f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.074334:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f0f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.074339:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07600 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217005.074343:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f0f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.074351:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f0f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.074374:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88e647d05100) 00010000:00010000:0.0:1782217005.074385:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1782217005.074389:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f0f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.074395:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f0f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217005.074467:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+12:10434:x1868789714036864:12345-192.168.203.19@tcp:55:lhsmtool_posix.0 Request processed in 17816us (19721us total) trans 0 rc -22/-22 00000100:00100000:0.0:1782217005.074475:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 82 00000100:00100000:3.0:1782217005.078466:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217005.078713:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714037120 00000100:00100000:1.0:1782217005.078731:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714037120 00000100:00100000:1.0:1782217005.078830:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 33 00000100:00100000:1.0:1782217005.078845:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a51b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:2359:x1868789714037120:12345-192.168.203.19@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1782217005.078931:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008ebe93e7/0xf210a9075089f0ff lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217005.078957:0:6580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006b6373d3/0xf210a9075089f0e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62035b expref: 7 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217005.078967:0:6580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1782217005.078971:0:6580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782217005.078975:0:6580:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ebe93e7/0xf210a9075089f0ff lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217005.079023:0:6580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006b6373d3/0xf210a9075089f0e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62035b expref: 7 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217005.079041:0:6580:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006b6373d3/0xf210a9075089f0e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62035b expref: 7 pid: 6578 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217005.079082:0:6580:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e649192300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6580:1868789733982720:192.168.203.19@tcp:104: 00000100:00100000:1.0:1782217005.079213:0:6580:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64e380d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782217005.086265:0:6580:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e649192300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6580:1868789733982720:192.168.203.19@tcp:104: 00010000:00010000:3.0:1782217005.086307:0:6580:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008ebe93e7/0xf210a9075089f0ff lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217005.087105:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217005.087989:0:8301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714037248 00000100:00100000:1.0:1782217005.088003:0:8301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714037248 00010000:00010000:1.0:1782217005.088057:0:8301:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006b6373d3/0xf210a9075089f0e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62035b expref: 8 pid: 6578 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217005.088162:0:8301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 44 00000100:00100000:1.0:1782217005.088175:0:8301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664487100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:10ba4d21-74e8-42e8-8e52-48a327751cbd+8:2359:x1868789714037248:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782217005.088197:0:8301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217005.088226:0:8301:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006b6373d3/0xf210a9075089f0e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62035b expref: 8 pid: 6578 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217005.088243:0:8301:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006b6373d3/0xf210a9075089f0e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62035b expref: 8 pid: 6578 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217005.088276:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b6373d3/0xf210a9075089f0e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62035b expref: 8 pid: 6578 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217005.088294:0:8301:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782217005.088298:0:8301:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782217005.088305:0:8301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ebe93e7/0xf210a9075089f0ff lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217005.088332:0:8301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ebe93e7/0xf210a9075089f0ff lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217005.088370:0:8301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782217005.088452:0:8301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664487100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:2359:x1868789714037248:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 278us (1351us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217005.088462:0:8301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 44 00010000:00010000:3.0:1782217005.089023:0:6580:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008ebe93e7/0xf210a9075089f0ff lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.089036:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ebe93e7/0xf210a9075089f0ff lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.089068:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008ebe93e7/0xf210a9075089f0ff lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.089077:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ebe93e7/0xf210a9075089f0ff lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.089087:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ebe93e7/0xf210a9075089f0ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.089104:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06c00 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217005.089110:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ebe93e7/0xf210a9075089f0ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.089120:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ebe93e7/0xf210a9075089f0ff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.089135:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ebe93e7/0xf210a9075089f0ff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.089143:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ebe93e7/0xf210a9075089f0ff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217005.089217:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a51b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2359:x1868789714037120:12345-192.168.203.19@tcp:1:lhsmtool_posix.0 Request processed in 10375us (10759us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217005.089226:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 33 00000100:00100000:1.0:1782217005.111159:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217005.113346:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714037504 00000100:00100000:2.0:1782217005.113371:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714037504 00000100:00100000:2.0:1782217005.113451:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 83 00000100:00100000:2.0:1782217005.113461:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+12:10434:x1868789714037504:12345-192.168.203.19@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1782217005.113545:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aea00/0xf210a9075089f106 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217005.113561:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aea00/0xf210a9075089f106 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217005.113574:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aea00/0xf210a9075089f106 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217005.113769:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089f10d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217005.113780:0:6855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f0c0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620346 expref: 13 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217005.113789:0:6855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089f10d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217005.113822:0:6855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f0c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620346 expref: 13 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217005.113848:0:6855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f0c0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620346 expref: 13 pid: 5785 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217005.113862:0:6855:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f7a1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6855:1868789733982848:192.168.203.19@tcp:104: 00000100:00100000:2.0:1782217005.113988:0:6855:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e68058d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782217005.116764:0:6855:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f7a1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6855:1868789733982848:192.168.203.19@tcp:104: 00010000:00010000:2.0:1782217005.116794:0:6855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089f10d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217005.121628:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217005.127204:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714037632 00000100:00100000:2.0:1782217005.127226:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714037632 00010000:00010000:2.0:1782217005.127286:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f0c0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620346 expref: 14 pid: 5785 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217005.127335:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 45 00000100:00100000:2.0:1782217005.127347:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649193b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+14:2358:x1868789714037632:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217005.127367:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217005.127386:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f0c0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620346 expref: 14 pid: 5785 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217005.127402:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f0c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620346 expref: 14 pid: 5785 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217005.127432:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f0c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620346 expref: 14 pid: 5785 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217005.130101:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88e647d05100) 00010000:00010000:2.0:1782217005.130118:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089f10d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217005.130136:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089f10d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217005.130144:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089f10d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.130262:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782217005.130293:0:6855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089f10d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217005.130304:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089f10d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217005.130348:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649193b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+13:2358:x1868789714037632:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 2996us (8729us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217005.130369:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 45 00000001:00080000:2.0:1782217005.130617:0:6855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1782217005.131428:0:6855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1782217005.131482:0:6855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1782217005.131625:0:6855:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f7a1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6855:1868789733982976:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1782217005.131810:0:6855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217005.131860:0:6855:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e644494180 going to sleep for 11 seconds 00000100:00100000:0.0:1782217005.131971:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733982976 00000100:00100000:0.0:1782217005.131984:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733982976 00000100:00100000:0.0:1782217005.132048:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782217005.132057:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f7a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6855:x1868789733982976:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1782217005.132170:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f7a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6855:x1868789733982976:12345-0@lo:1000:mdt00_003.0 Request processed in 113us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217005.132178:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782217005.132352:0:6855:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1782217005.132360:0:6855:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88e664487480, transno 4294967303 00000100:00100000:2.0:1782217005.132394:0:6855:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f7a1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6855:1868789733982976:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1782217005.133405:0:6855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1782217005.133531:0:6855:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f7a1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6855:1868789733983104:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1782217005.133603:0:6855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217005.133649:0:6855:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64e0d3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782217005.134418:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733983104 00000100:00100000:0.0:1782217005.134431:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733983104 00000100:00100000:0.0:1782217005.134496:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782217005.134507:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f7a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6855:x1868789733983104:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1782217005.134809:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f7a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6855:x1868789733983104:12345-0@lo:1000:mdt00_003.0 Request processed in 303us (1205us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1782217005.134819:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782217005.134867:0:6855:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f7a1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6855:1868789733983104:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1782217005.143871:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089f10d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.143987:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089f10d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.144023:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089f10d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.144030:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738af600 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217005.144036:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089f10d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.144045:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089f10d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.144068:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88e647d05100) 00010000:00010000:0.0:1782217005.144071:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782217005.144076:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089f10d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.144083:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089f10d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.144135:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f03b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.144142:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f03b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.144148:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f03b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.144153:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06600 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217005.144156:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f03b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.144173:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f03b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.144183:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e67a811200) 00010000:00010000:0.0:1782217005.144186:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782217005.144190:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f03b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.144196:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f03b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.144222:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f114 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.144243:0:6855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f057 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62032a expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.144254:0:6855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f114 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.144310:0:6855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f057 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62032a expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.144328:0:6855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f057 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62032a expref: 16 pid: 5784 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217005.144347:0:6855:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6855:1868789733983232:192.168.203.19@tcp:104: 00000100:00100000:0.0:1782217005.144495:0:6855:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e67f6de9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782217005.148534:0:6855:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6855:1868789733983232:192.168.203.19@tcp:104: 00010000:00010000:0.0:1782217005.148599:0:6855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f114 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217005.164511:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217005.164599:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714037760 00000100:00100000:3.0:1782217005.164612:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714037760 00010000:00010000:3.0:1782217005.164669:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f057 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62032a expref: 17 pid: 5784 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217005.164720:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 46 00000100:00100000:3.0:1782217005.164731:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649190700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+17:2358:x1868789714037760:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217005.164752:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217005.164779:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f057 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62032a expref: 17 pid: 5784 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.164796:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f057 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62032a expref: 17 pid: 5784 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.164824:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f057 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62032a expref: 17 pid: 5784 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.164841:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e67a811200) 00010000:00010000:3.0:1782217005.164847:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f114 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.164859:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f114 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.164868:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f114 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.164956:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782217005.164970:0:6855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f114 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.164987:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f114 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.165005:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f114 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.165014:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f114 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217005.165027:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649190700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+16:2358:x1868789714037760:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 295us (523us total) trans 0 rc 0/0 00010000:00010000:0.0:1782217005.165028:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f114 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.165054:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437bc00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217005.165059:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f114 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.165067:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f114 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.165086:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e67a811200) 00010000:00010000:0.0:1782217005.165089:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217005.165093:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f114 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.165099:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f114 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.165135:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aea00/0xf210a9075089f106 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.165141:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aea00/0xf210a9075089f106 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.165147:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aea00/0xf210a9075089f106 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.165152:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738aea00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217005.165156:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aea00/0xf210a9075089f106 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.165162:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aea00/0xf210a9075089f106 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.165169:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e67a811200) 00010000:00010000:0.0:1782217005.165172:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782217005.165174:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aea00/0xf210a9075089f106 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.165181:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aea00/0xf210a9075089f106 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217005.165190:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 46 00000100:00100000:0.0:1782217005.165475:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+15:10434:x1868789714037504:12345-192.168.203.19@tcp:57:lhsmtool_posix.0 Request processed in 52009us (54324us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1782217005.165487:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 83 00000020:00080000:0.0:1782217005.165494:0:6855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1782217005.166358:0:11532:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782217005.166366:0:11532:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782217005.166412:0:11532:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1782217005.166420:0:11532:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782217005.171620:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217005.172018:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714038016 00000100:00100000:3.0:1782217005.172032:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714038016 00000100:00100000:3.0:1782217005.172107:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 20 00000100:00100000:3.0:1782217005.172132:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+15:10434:x1868789714038016:12345-192.168.203.19@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1782217005.173021:0:5786:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1782217005.173141:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1782217005.173203:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f11b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.173225:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f11b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.173240:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f11b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.173250:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f11b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.173256:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f11b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.173264:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f11b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.173287:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782217005.173425:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+17:10434:x1868789714038016:12345-192.168.203.19@tcp:35:lhsmtool_posix.0 Request processed in 1292us (1815us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1782217005.173436:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 20 00000020:00080000:3.0:1782217005.173442:0:5786:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1782217005.174017:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782217005.174028:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f11b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217005.174039:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640030600 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:1.0:1782217005.174044:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f11b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217005.174066:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f11b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217005.174084:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88e650a64500) 00010000:00010000:1.0:1782217005.174088:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782217005.174094:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f11b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217005.174100:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f11b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217005.174135:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217005.174137:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217005.174139:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217005.529291:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782217005.529326:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733983360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782217005.529452:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217005.529543:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733983360 00000100:00100000:0.0:1782217005.529552:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733983360 00000100:00100000:0.0:1782217005.529611:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1782217005.529623:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1868789733983360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782217005.529659:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1782217005.529711:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1868789733983360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217005.529719:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1782217005.529780:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733983360:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1782217005.549859:0:11850:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782217005.549912:0:11850:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782217005.549965:0:11850:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1782217005.549973:0:11850:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1782217005.657560:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217005.700290:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217005.701026:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714038272 00000100:00100000:1.0:1782217005.701039:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714038272 00000100:00100000:1.0:1782217005.701102:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 84 00000100:00100000:1.0:1782217005.701112:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+17:10453:x1868789714038272:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:1.0:1782217005.701141:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217005.701164:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f122 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620362 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217005.701706:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07c00/0xf210a9075089f129 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217005.701725:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07c00/0xf210a9075089f129 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217005.701742:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07c00/0xf210a9075089f129 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217005.701756:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1782217005.703339:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f122 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620362 expref: 20 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.703367:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07c00/0xf210a9075089f129 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620362 expref: 19 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.703396:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88e650a64700) 00010000:00010000:3.0:1782217005.703400:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782217005.703405:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd07c00, rc 0) 00000100:00100000:3.0:1782217005.703497:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+19:10453:x1868789714038272:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 2385us (3221us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1782217005.703506:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 84 00000100:00100000:0.0:1782217005.710945:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217005.710993:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714038400 00000100:00100000:0.0:1782217005.711003:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714038400 00000100:00100000:0.0:1782217005.711066:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 85 00000100:00100000:0.0:1782217005.711076:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+19:10453:x1868789714038400:12345-192.168.203.19@tcp:34:lfs.0 00010000:00010000:0.0:1782217005.711151:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f137 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.711168:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f137 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.711179:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f137 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.711194:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089f13e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.711201:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089f13e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.711217:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089f13e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.711534:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f145 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.711544:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.711554:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782217005.711591:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.711605:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f137 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.711612:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f137 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.711619:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f137 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.711625:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437a000 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217005.711701:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f137 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.711712:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f137 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.711727:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88e650a64700) 00010000:00010000:0.0:1782217005.711737:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217005.711749:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f137 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.711756:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f137 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.711770:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089f13e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.711777:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089f13e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.711783:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089f13e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.711788:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437ba00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217005.711791:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089f13e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.711797:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089f13e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.711804:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88e647d05100) 00010000:00010000:0.0:1782217005.711806:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217005.711809:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089f13e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.711814:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089f13e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.711828:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.711841:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f145 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.711847:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f145 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.711852:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437bc00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217005.711855:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f145 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.711861:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f145 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.711868:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e647d05e00) 00010000:00010000:0.0:1782217005.711870:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217005.711873:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f145 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.711906:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f145 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217005.711984:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+19:10453:x1868789714038400:12345-192.168.203.19@tcp:34:lfs.0 Request processed in 908us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217005.711993:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 85 00000100:00100000:3.0:1782217005.783320:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217005.783364:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714038656 00000100:00100000:3.0:1782217005.783384:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714038656 00000100:00100000:3.0:1782217005.783448:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 86 00000100:00100000:3.0:1782217005.783458:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+19:10456:x1868789714038656:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:3.0:1782217005.783485:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217005.783509:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089f14c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620369 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.783604:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f153 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.783621:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f153 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.783634:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f153 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.783650:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089f15a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.783658:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089f15a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.783675:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089f15a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.784105:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089f161 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.784116:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089f161 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.784124:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089f161 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217005.784135:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1782217005.784233:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f153 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.784241:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f153 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.784249:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f153 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.784255:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640030600 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217005.784259:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f153 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.784268:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f153 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.784280:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88e650a64700) 00010000:00010000:3.0:1782217005.784283:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217005.784294:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f153 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.784300:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f153 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.784313:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089f15a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.784320:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089f15a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.784326:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089f15a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.784330:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640031e00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217005.784333:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089f15a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.784338:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089f15a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.784344:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88e650a64200) 00010000:00010000:3.0:1782217005.784347:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217005.784349:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089f15a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.784354:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089f15a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.784410:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089f14c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620369 expref: 22 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.784435:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089f161 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620369 expref: 21 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.784443:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e650a64f00) 00010000:00010000:3.0:1782217005.784446:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782217005.784448:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e640030200, rc 0) 00000100:00100000:3.0:1782217005.784521:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+21:10456:x1868789714038656:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 1064us (1216us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1782217005.784529:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 86 00000100:00100000:0.0:1782217005.811597:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217005.811731:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714038784 00000100:00100000:3.0:1782217005.811747:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714038784 00000100:00100000:3.0:1782217005.811919:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 87 00000100:00100000:3.0:1782217005.811931:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+21:10456:x1868789714038784:12345-192.168.203.19@tcp:54:lfs.0 00010000:00010000:3.0:1782217005.812022:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f16f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.812043:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f16f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.812057:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f16f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.812349:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f16f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.812358:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f16f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.812389:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f16f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.812396:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e653161200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217005.812401:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f16f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.812409:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f16f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.812425:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e650a64f00) 00010000:00010000:3.0:1782217005.812428:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782217005.812434:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f16f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.812441:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f16f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217005.812576:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+21:10456:x1868789714038784:12345-192.168.203.19@tcp:54:lfs.0 Request processed in 646us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217005.812586:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 87 00000100:00100000:3.0:1782217005.826054:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217005.826097:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714039040 00000100:00100000:3.0:1782217005.826108:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714039040 00000100:00100000:3.0:1782217005.826169:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 21 00000100:00100000:3.0:1782217005.826179:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664ed0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+21:10456:x1868789714039040:12345-192.168.203.19@tcp:35:lfs.0 00000100:00100000:3.0:1782217005.826490:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664ed0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+22:10456:x1868789714039040:12345-192.168.203.19@tcp:35:lfs.0 Request processed in 309us (447us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1782217005.826515:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 21 00000100:00100000:0.0:1782217005.860583:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217005.861316:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714039296 00000100:00100000:3.0:1782217005.861331:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714039296 00000100:00100000:3.0:1782217005.861423:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 88 00000100:00100000:3.0:1782217005.861436:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+22:9986:x1868789714039296:12345-192.168.203.19@tcp:101:bash.0 00010000:00010000:3.0:1782217005.861469:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217005.861496:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f176 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620370 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.861641:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f17d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.861657:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089f161 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620369 expref: 23 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.861667:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f17d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.861707:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089f161 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620369 expref: 23 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.861722:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089f161 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620369 expref: 23 pid: 5785 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217005.861737:0:5785:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664485f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1868789733983488:192.168.203.19@tcp:104: 00000100:00100000:3.0:1782217005.861937:0:5785:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e642ba33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782217005.869572:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217005.869763:0:8300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714039424 00000100:00100000:1.0:1782217005.869775:0:8300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714039424 00010000:00010000:1.0:1782217005.869826:0:8300:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089f161 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620369 expref: 24 pid: 5785 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217005.869917:0:8300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 47 00000100:00100000:1.0:1782217005.869927:0:8300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+24:2358:x1868789714039424:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782217005.869966:0:8300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217005.869974:0:8300:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089f161 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620369 expref: 24 pid: 5785 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217005.869988:0:8300:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089f161 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620369 expref: 24 pid: 5785 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217005.870015:0:8300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e650a64f00) 00010000:00010000:1.0:1782217005.870021:0:8300:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f17d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217005.870031:0:8300:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f17d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217005.870039:0:8300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f17d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217005.870062:0:8300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782217005.870126:0:8300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+24:2358:x1868789714039424:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 199us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217005.870136:0:8300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 47 00010000:00010000:3.0:1782217005.870903:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089f161 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620369 expref: 23 pid: 5785 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217005.870937:0:5785:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664485f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1868789733983488:192.168.203.19@tcp:104: 00010000:00010000:3.0:1782217005.870963:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f17d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.870972:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f17d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.870977:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f17d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217005.871001:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1782217005.871484:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f176 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620370 expref: 24 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.871504:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f17d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620370 expref: 23 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217005.871513:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e650a64f00) 00010000:00010000:3.0:1782217005.871517:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782217005.871521:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e653160400, rc 0) 00000100:00100000:3.0:1782217005.871795:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+23:9986:x1868789714039296:12345-192.168.203.19@tcp:101:bash.0 Request processed in 10360us (11238us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1782217005.871806:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 88 00000100:00100000:3.0:1782217005.877006:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217005.877325:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714039680 00000100:00100000:1.0:1782217005.877339:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714039680 00000100:00100000:1.0:1782217005.877429:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 89 00000100:00100000:1.0:1782217005.877441:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+23:9986:x1868789714039680:12345-192.168.203.19@tcp:36:bash.0 00010000:00010000:1.0:1782217005.877817:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f18b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217005.877840:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f18b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217005.877932:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f18b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782217005.878000:0:5784:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1782217005.878027:0:5784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c4c68dd9 reply state 0000000011b7bd15 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f18b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217005.878039:0:5784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1782217005.878088:0:5784:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1782217005.878229:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+27:9986:x1868789714039680:12345-192.168.203.19@tcp:36:bash.0 Request processed in 788us (1238us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1782217005.878236:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 89 00000020:00080000:1.0:1782217005.878242:0:5784:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1782217005.882835:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f18b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.882948:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f18b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.882957:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f18b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.882964:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07e00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217005.883025:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f18b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.883035:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f18b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.883057:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e650a64f00) 00010000:00010000:0.0:1782217005.883061:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217005.883067:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f18b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.883073:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f18b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217005.889773:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217005.893239:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714039808 00000100:00100000:0.0:1782217005.893259:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714039808 00000100:00100000:0.0:1782217005.893356:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 90 00000100:00100000:0.0:1782217005.893369:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+26:9986:x1868789714039808:12345-192.168.203.19@tcp:101:bash.0 00010000:00010000:0.0:1782217005.893412:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217005.893437:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f192 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620377 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.893512:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f192 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620377 expref: 27 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.893546:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f192 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620377 expref: 27 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.893571:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e650a64f00) 00010000:00010000:0.0:1782217005.893575:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782217005.893579:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437aa00, rc 0) 00000100:00100000:0.0:1782217005.893646:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+27:9986:x1868789714039808:12345-192.168.203.19@tcp:101:bash.0 Request processed in 280us (3887us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217005.893653:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 90 00000100:00100000:1.0:1782217005.897557:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217005.897710:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714039936 00000100:00100000:0.0:1782217005.897722:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714039936 00000100:00100000:0.0:1782217005.897793:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 34 00000100:00100000:0.0:1782217005.897804:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649191c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:9986:x1868789714039936:12345-192.168.203.19@tcp:101:bash.0 00010000:00010000:0.0:1782217005.897828:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217005.897856:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afb2944d/0xf210a9075089f199 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62037e expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782217005.897931:0:6579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a3a792b, atime: 0x6a3a7929, ctime: 0x6a3a792b, blocks: 0xb 00010000:00010000:0.0:1782217005.897956:0:6579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=324s v=(0 0) 00010000:00010000:0.0:1782217005.897961:0:6579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217005.897971:0:6579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afb2944d/0xf210a9075089f199 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62037e expref: 7 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.897989:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000afb2944d/0xf210a9075089f199 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62037e expref: 7 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217005.898026:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437ac00, rc 0) 00000100:00100000:0.0:1782217005.898096:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649191c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:9986:x1868789714039936:12345-192.168.203.19@tcp:101:bash.0 Request processed in 295us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217005.898104:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 34 00000100:00100000:1.0:1782217005.902305:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217005.902460:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714040064 00000100:00100000:2.0:1782217005.902473:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714040064 00002000:00010000:2.0:1782217005.902521:0:6583:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1782217005.902527:0:6583:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff88e649190000 with x1868789714040064 ext(0->18446744073709551615) 00002000:00010000:2.0:1782217005.902541:0:6583:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88e649190000. 00000100:00100000:2.0:1782217005.902730:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 1 00000100:00100000:2.0:1782217005.902750:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:2357:x1868789714040064:12345-192.168.203.19@tcp:10:bash.0 00002000:00010000:2.0:1782217005.903637:0:6583:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1782217005.903643:0:6583:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1782217003 -> 1782217005 00002000:00010000:2.0:1782217005.903646:0:6583:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1782217001 -> 1782217001 00002000:00010000:2.0:1782217005.903648:0:6583:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1782217003 -> 1782217005 00002000:00010000:2.0:1782217005.903651:0:6583:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1782217005.903728:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+8:2357:x1868789714040064:12345-192.168.203.19@tcp:10:bash.0 Request processed in 978us (1434us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1782217005.903846:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 1 00002000:00010000:2.0:1782217005.903851:0:6583:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1782217005.903855:0:6583:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff88e649190000 with x1868789714040064 ext(0->18446744073709551615) 00002000:00010000:2.0:1782217005.903861:0:6583:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88e649190000. 00000100:00100000:1.0:1782217006.016152:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217006.016313:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714040192 00000100:00100000:0.0:1782217006.016327:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714040192 00000100:00100000:0.0:1782217006.016434:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 91 00000100:00100000:0.0:1782217006.016448:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+27:10470:x1868789714040192:12345-192.168.203.19@tcp:34:lfs.0 00010000:00010000:0.0:1782217006.016562:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f1a0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.016585:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f1a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.016601:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f1a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.016630:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f1a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.016638:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f1a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.016644:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f1a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1782217006.016834:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782217006.017079:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089f1ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.017262:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089f1ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.017270:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089f1ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782217006.017325:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089f1ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.017339:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f1a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.017347:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f1a0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.017355:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f1a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.017361:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437b200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217006.017366:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f1a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.017384:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f1a0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.017398:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88e650a64700) 00010000:00010000:0.0:1782217006.017403:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217006.017408:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f1a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.017414:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f1a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.017435:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f1a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.017442:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f1a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.017449:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f1a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.017454:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437a600 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217006.017458:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f1a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.017464:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f1a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.017473:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88e647d05000) 00010000:00010000:0.0:1782217006.017476:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217006.017479:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f1a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.017485:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f1a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.017500:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089f1ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.017506:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089f1ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.017512:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089f1ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.017523:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437b000 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217006.017527:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089f1ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.017533:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089f1ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.017541:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e650a64f00) 00010000:00010000:0.0:1782217006.017544:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217006.017546:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089f1ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.017552:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089f1ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217006.018270:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+27:10470:x1868789714040192:12345-192.168.203.19@tcp:34:lfs.0 Request processed in 1818us (2129us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217006.018283:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 91 00000100:00100000:1.0:1782217006.074142:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217006.084952:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714040448 00000100:00100000:0.0:1782217006.084973:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714040448 00000100:00100000:0.0:1782217006.085082:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 92 00000100:00100000:0.0:1782217006.085097:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+27:10473:x1868789714040448:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:0.0:1782217006.085129:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217006.085155:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089f1b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620385 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.085437:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f1bc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.088233:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f1bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.088251:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f1bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.088285:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f1c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.088293:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f1c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.088300:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f1c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.089132:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f1ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.089147:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f1ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.089156:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f1ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217006.089171:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1782217006.089495:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f1bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.089621:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f1bc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.089629:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f1bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.089654:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437a600 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217006.090047:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f1bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.090059:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f1bc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.090075:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88e650a64700) 00010000:00010000:0.0:1782217006.090078:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217006.090083:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f1bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.090090:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f1bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.090107:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f1c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.090113:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f1c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.090119:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f1c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.090124:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437b200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217006.090126:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f1c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.090132:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f1c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.090152:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88e647d05000) 00010000:00010000:0.0:1782217006.090154:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217006.090157:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f1c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.090163:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f1c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.090420:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089f1b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620385 expref: 30 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.090439:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f1ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620385 expref: 29 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.090831:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e650a64f00) 00010000:00010000:0.0:1782217006.090835:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1782217006.090839:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437ae00, rc 0) 00000100:00100000:0.0:1782217006.091128:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+29:10473:x1868789714040448:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 6031us (16999us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1782217006.091139:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 92 00000100:00100000:1.0:1782217006.106439:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217006.106780:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714040576 00000100:00100000:0.0:1782217006.106793:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714040576 00000100:00100000:0.0:1782217006.106868:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 93 00000100:00100000:0.0:1782217006.106920:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+29:10473:x1868789714040576:12345-192.168.203.19@tcp:54:lfs.0 00010000:00010000:0.0:1782217006.107015:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089f1d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.107036:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f17d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620370 expref: 29 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.107069:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089f1d8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.107113:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f17d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620370 expref: 29 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.107128:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f17d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620370 expref: 29 pid: 5785 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217006.107144:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5784:1868789733983616:192.168.203.19@tcp:104: 00000100:00100000:0.0:1782217006.107631:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e679faa6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782217006.112394:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5784:1868789733983616:192.168.203.19@tcp:104: 00010000:00010000:0.0:1782217006.112436:0:5784:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089f1d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217006.117067:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217006.117331:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714040832 00000100:00100000:3.0:1782217006.117344:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714040832 00000100:00100000:3.0:1782217006.117460:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 22 00000100:00100000:3.0:1782217006.117472:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+30:5570:x1868789714040832:12345-192.168.203.19@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1782217006.117969:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+31:5570:x1868789714040832:12345-192.168.203.19@tcp:35:ldlm_bl.0 Request processed in 496us (914us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1782217006.117979:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 22 00000100:00100000:1.0:1782217006.120455:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217006.120671:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714040960 00000100:00100000:0.0:1782217006.120684:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714040960 00010000:00010000:0.0:1782217006.120735:0:8299:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f17d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620370 expref: 31 pid: 5785 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217006.120789:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 48 00000100:00100000:0.0:1782217006.120801:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649191f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+31:2359:x1868789714040960:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217006.120821:0:8299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217006.120829:0:8299:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f17d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620370 expref: 31 pid: 5785 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.120910:0:8299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f17d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620370 expref: 31 pid: 5785 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.120940:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f17d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620370 expref: 31 pid: 5785 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.120961:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e650a64f00) 00010000:00010000:0.0:1782217006.120967:0:8299:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089f1d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.120979:0:8299:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089f1d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.120987:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089f1d8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.121015:0:8299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217006.121088:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649191f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+30:2359:x1868789714040960:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 288us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217006.121097:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 48 00010000:00010000:1.0:1782217006.121717:0:5784:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089f1d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.121728:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089f1d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.121767:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089f1d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.121776:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089f1d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.121794:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089f1d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.121801:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437b000 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217006.121806:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089f1d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.121814:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089f1d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.121826:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e650a64f00) 00010000:00010000:1.0:1782217006.121830:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782217006.121834:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089f1d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.121841:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089f1d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217006.121965:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+29:10473:x1868789714040576:12345-192.168.203.19@tcp:54:lfs.0 Request processed in 15085us (15538us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217006.121974:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 93 00000100:00100000:1.0:1782217006.130740:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217006.131596:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714041216 00000100:00100000:3.0:1782217006.131610:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714041216 00000100:00100000:3.0:1782217006.131700:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 23 00000100:00100000:3.0:1782217006.131712:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+29:10473:x1868789714041216:12345-192.168.203.19@tcp:35:lfs.0 00000100:00100000:3.0:1782217006.132181:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+30:10473:x1868789714041216:12345-192.168.203.19@tcp:35:lfs.0 Request processed in 468us (1453us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1782217006.132191:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 23 00000100:00100000:2.0:1782217006.258566:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217006.258788:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714041472 00000100:00100000:3.0:1782217006.258801:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714041472 00000100:00100000:3.0:1782217006.258908:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 94 00000100:00100000:3.0:1782217006.258921:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f7a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+30:10484:x1868789714041472:12345-192.168.203.19@tcp:101:cat.0 00010000:00010000:3.0:1782217006.258954:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217006.258981:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f1df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62038c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.259086:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f1e6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.259106:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f1e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.259120:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f1e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.259156:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a9075089f1ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.259164:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a9075089f1ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.259171:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a9075089f1ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.260101:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f1f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.260119:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f1f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.260130:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f1f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217006.260144:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1782217006.260261:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f1e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.260270:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f1e6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.260278:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f1e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.260285:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e653161c00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217006.260291:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f1e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.260310:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f1e6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.260326:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88e650a64700) 00010000:00010000:3.0:1782217006.260330:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217006.260336:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f1e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.262303:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f1e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.262432:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a9075089f1ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.262441:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a9075089f1ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.262450:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a9075089f1ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.262457:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e653161600 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217006.262462:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a9075089f1ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.262470:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a9075089f1ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.262489:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88e650a64200) 00010000:00010000:3.0:1782217006.262494:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217006.262499:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a9075089f1ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.262533:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a9075089f1ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.263000:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f1df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62038c expref: 33 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.263027:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f1f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62038c expref: 32 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.263035:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e650a64f00) 00010000:00010000:3.0:1782217006.263039:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782217006.263041:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e653160e00, rc 0) 00000100:00100000:3.0:1782217006.263140:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f7a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+32:10484:x1868789714041472:12345-192.168.203.19@tcp:101:cat.0 Request processed in 4220us (4595us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1782217006.263151:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 94 00000100:00100000:1.0:1782217006.270143:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217006.270313:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714041728 00000100:00100000:3.0:1782217006.270325:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714041728 00000100:00100000:3.0:1782217006.270410:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 24 00000100:00100000:3.0:1782217006.270422:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+32:10484:x1868789714041728:12345-192.168.203.19@tcp:35:cat.0 00000100:00100000:3.0:1782217006.270750:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+33:10484:x1868789714041728:12345-192.168.203.19@tcp:35:cat.0 Request processed in 329us (621us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1782217006.270758:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 24 00000100:00100000:1.0:1782217006.299077:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217006.299238:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714041984 00000100:00100000:3.0:1782217006.299251:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714041984 00000100:00100000:3.0:1782217006.299325:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 95 00000100:00100000:3.0:1782217006.299342:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+33:10485:x1868789714041984:12345-192.168.203.19@tcp:36:rm.0 00010000:00010000:3.0:1782217006.299452:0:6855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1782217006.299487:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f1f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62038c expref: 33 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.299529:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f1ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620385 expref: 32 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.299544:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f192 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620377 expref: 31 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.299556:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e650a64f00) 00010000:00010000:3.0:1782217006.299569:0:6855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782217006.299602:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f202 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.299621:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f202 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.299632:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f202 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.299661:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a9075089f209 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.299670:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a9075089f209 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.299676:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a9075089f209 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.300484:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f210 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.300502:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f210 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.300704:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f210 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782217006.307764:0:6855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:3.0:1782217006.307784:0:6855:0:(osp_sync.c:1862:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 325359906509ns, next at 326359901549ns, rc = 0 00010000:00010000:3.0:1782217006.307926:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f217 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.307946:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f217 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.307959:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f217 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.307970:0:6855:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f217 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.307976:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f217 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.307983:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f217 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.308005:0:6855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782217006.308034:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f210 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.308069:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f210 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.308076:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f210 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.308083:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e653161c00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217006.308088:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f210 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.308098:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f210 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.308113:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e650a64900) 00010000:00010000:3.0:1782217006.308117:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782217006.308122:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f210 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.308128:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f210 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.308153:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f202 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.308159:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f202 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.308166:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f202 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.308171:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e653161200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217006.308181:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f202 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.308187:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f202 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.308197:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88e650a64700) 00010000:00010000:3.0:1782217006.308200:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217006.308203:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f202 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.308209:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f202 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782217006.308220:0:6855:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000034d986c4 reply state 000000001b24c2b3 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a9075089f209 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217006.308230:0:6855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782217006.308347:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+32:10485:x1868789714041984:12345-192.168.203.19@tcp:36:rm.0 Request processed in 9006us (9291us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1782217006.308357:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 95 00010000:00010000:2.0:1782217006.309245:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782217006.309269:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f217 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217006.309278:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e653160400 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:2.0:1782217006.309282:0:5772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f217 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217006.309291:0:5772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f217 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217006.309305:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88e650a64900) 00010000:00010000:2.0:1782217006.309308:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782217006.309312:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f217 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217006.309318:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f217 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217006.309344:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217006.309346:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217006.309348:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217006.313997:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a9075089f209 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.314022:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a9075089f209 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.314031:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a9075089f209 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.314038:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e653161600 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217006.314044:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a9075089f209 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.314210:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a9075089f209 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.314234:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88e650a64200) 00010000:00010000:3.0:1782217006.314238:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217006.314243:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a9075089f209 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.314250:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a9075089f209 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217006.366480:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217006.366720:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714042240 00000100:00100000:0.0:1782217006.366733:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714042240 00000100:00100000:0.0:1782217006.366806:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 96 00000100:00100000:0.0:1782217006.366819:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649192300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+31:10491:x1868789714042240:12345-192.168.203.19@tcp:101:bash.0 00010000:00010000:0.0:1782217006.366851:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217006.366933:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f21e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620393 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.367320:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f225 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.367338:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f225 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.367359:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f225 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.367386:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f22c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.367395:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f22c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.367402:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f22c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782217006.368177:0:5783:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1782217006.368348:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f233 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.368358:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f233 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.368364:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f233 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.368416:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f225 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.368424:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f225 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.368431:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f225 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.368437:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217006.368449:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f225 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.368458:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f225 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.368471:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88e650a64700) 00010000:00010000:1.0:1782217006.368474:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217006.368479:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f225 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.368486:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f225 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782217006.368500:0:5783:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007108dfaa reply state 000000008121efc2 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f22c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217006.368510:0:5783:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782217006.368548:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f21e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620393 expref: 34 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.368565:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f233 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620393 expref: 33 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.368574:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88e67a811d00) 00010000:00010000:1.0:1782217006.368576:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782217006.368579:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd06c00, rc 0) 00000100:00100000:1.0:1782217006.368811:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649192300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+34:10491:x1868789714042240:12345-192.168.203.19@tcp:101:bash.0 Request processed in 1994us (2343us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1782217006.368821:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 96 00000100:00100000:1.0:1782217006.375626:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217006.376137:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714042368 00000100:00100000:3.0:1782217006.376149:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714042368 00000100:00100000:3.0:1782217006.376244:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 35 00000100:00100000:3.0:1782217006.376257:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:2358:x1868789714042368:12345-192.168.203.19@tcp:101:bash.0 00010000:00010000:3.0:1782217006.376280:0:7991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217006.376309:0:7991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eccd78e7/0xf210a9075089f241 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62039a expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782217006.376341:0:7991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782217006.376361:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f22c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.376386:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f22c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.376395:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f22c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.376401:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06600 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217006.376407:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f22c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.376416:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f22c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1782217006.376471:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782217006.376546:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88e67a811300) 00010000:00010000:0.0:1782217006.376551:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217006.376557:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f22c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.376565:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f22c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.377268:0:7991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=325s v=(0 0) 00010000:00010000:1.0:1782217006.377275:0:7991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217006.377289:0:7991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eccd78e7/0xf210a9075089f241 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62039a expref: 8 pid: 7991 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.377314:0:7991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eccd78e7/0xf210a9075089f241 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62039a expref: 8 pid: 7991 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.377330:0:7991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e653161600, rc 0) 00000100:00100000:1.0:1782217006.379467:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+8:2358:x1868789714042368:12345-192.168.203.19@tcp:101:bash.0 Request processed in 1610us (2252us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217006.379485:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 35 00000100:00100000:2.0:1782217006.383675:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217006.384099:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714042496 00000100:00100000:0.0:1782217006.384112:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714042496 00000100:00100000:0.0:1782217006.384181:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 36 00000100:00100000:0.0:1782217006.384192:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f7a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+8:10491:x1868789714042496:12345-192.168.203.19@tcp:101:bash.0 00010000:00010000:0.0:1782217006.384215:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217006.384253:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3d28536/0xf210a9075089f248 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6203a1 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.384294:0:6579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eccd78e7/0xf210a9075089f241 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62039a expref: 9 pid: 7991 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.384304:0:6579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217006.384309:0:6579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217006.384315:0:6579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3d28536/0xf210a9075089f248 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203a1 expref: 9 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.384356:0:6579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eccd78e7/0xf210a9075089f241 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62039a expref: 9 pid: 7991 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.384383:0:6579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eccd78e7/0xf210a9075089f241 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62039a expref: 9 pid: 7991 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217006.384400:0:6579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6579:1868789733983744:192.168.203.19@tcp:104: 00000100:00100000:0.0:1782217006.385731:0:6579:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e679faa6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782217006.389662:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217006.389804:0:6579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6579:1868789733983744:192.168.203.19@tcp:104: 00010000:00010000:0.0:1782217006.389849:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b3d28536/0xf210a9075089f248 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203a1 expref: 9 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.389990:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437b800, rc 0) 00000100:00100000:3.0:1782217006.390112:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714042624 00000100:00100000:3.0:1782217006.390121:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714042624 00010000:00010000:3.0:1782217006.390173:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eccd78e7/0xf210a9075089f241 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62039a expref: 10 pid: 7991 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217006.390222:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 49 00000100:00100000:3.0:1782217006.390233:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f7a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+10:2358:x1868789714042624:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217006.390272:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217006.390299:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eccd78e7/0xf210a9075089f241 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62039a expref: 10 pid: 7991 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.390312:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eccd78e7/0xf210a9075089f241 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62039a expref: 10 pid: 7991 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.390345:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eccd78e7/0xf210a9075089f241 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62039a expref: 10 pid: 7991 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.390362:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217006.390376:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217006.390387:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3d28536/0xf210a9075089f248 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203a1 expref: 9 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.390398:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3d28536/0xf210a9075089f248 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203a1 expref: 9 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.390440:0:5770:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b3d28536/0xf210a9075089f248 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203a1 expref: 9 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217006.390456:0:5770:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664484380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5770:1868789733983872:192.168.203.19@tcp:105: 00000100:00100000:3.0:1782217006.390553:0:5770:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e642ba3900 going to sleep for 11 seconds 00000100:00100000:0.0:1782217006.393434:0:5770:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664484380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5770:1868789733983872:192.168.203.19@tcp:105: 00010000:00010000:0.0:1782217006.393468:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217006.393555:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f7a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+9:2358:x1868789714042624:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 3323us (3906us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217006.393568:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 49 00000100:00100000:1.0:1782217006.395391:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f7a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+8:10491:x1868789714042496:12345-192.168.203.19@tcp:101:bash.0 Request processed in 11187us (12034us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217006.395406:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 36 00000100:00100000:3.0:1782217006.403236:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217006.403556:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714042880 00000100:00100000:1.0:1782217006.403569:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714042880 00000100:00100000:1.0:1782217006.403647:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 25 00000100:00100000:1.0:1782217006.403660:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+33:10491:x1868789714042880:12345-192.168.203.19@tcp:35:bash.0 00000100:00100000:1.0:1782217006.404172:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+34:10491:x1868789714042880:12345-192.168.203.19@tcp:35:bash.0 Request processed in 513us (948us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1782217006.404182:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 25 00000100:00100000:3.0:1782217006.543836:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217006.544163:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714043008 00000100:00100000:1.0:1782217006.544178:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714043008 00000100:00100000:1.0:1782217006.544262:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 97 00000100:00100000:1.0:1782217006.544274:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+34:10507:x1868789714043008:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:1.0:1782217006.544309:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217006.544334:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f24f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6203a8 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.544530:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f256 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.544546:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f256 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.544560:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f256 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217006.544636:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1782217006.544640:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1782217006.544681:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f256 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.544712:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f24f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203a8 expref: 36 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.544734:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f256 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203a8 expref: 35 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.544744:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88e650a64700) 00010000:00010000:1.0:1782217006.544747:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782217006.544751:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd07400, rc 0) 00000100:00100000:1.0:1782217006.544834:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+35:10507:x1868789714043008:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 562us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217006.544850:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 97 00000100:00100000:2.0:1782217006.549814:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217006.549953:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714043264 00000100:00100000:1.0:1782217006.549964:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714043264 00000100:00100000:1.0:1782217006.550034:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 98 00000100:00100000:1.0:1782217006.550046:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f7a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+35:10507:x1868789714043264:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:1.0:1782217006.550085:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217006.550112:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f25d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6203af expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.550246:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f264 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.550263:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f264 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.550277:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f264 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217006.550289:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1782217006.550472:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f25d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203af expref: 38 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.550494:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f264 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203af expref: 37 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.550504:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88e67a811d00) 00010000:00010000:1.0:1782217006.550507:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782217006.550511:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd07600, rc 0) 00000100:00100000:1.0:1782217006.550608:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f7a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+37:10507:x1868789714043264:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 563us (810us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1782217006.550616:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 98 00000100:00100000:3.0:1782217006.556381:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217006.556439:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217006.556522:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714043520 00000100:00100000:1.0:1782217006.556535:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714043520 00000100:00100000:1.0:1782217006.556601:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 99 00000100:00100000:1.0:1782217006.556612:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+37:10507:x1868789714043520:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:1.0:1782217006.556646:0:6855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217006.556668:0:6855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f272 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6203b6 expref: -99 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.556818:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f279 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.556837:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f279 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.556851:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f279 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217006.556903:0:6855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00000100:00100000:0.0:1782217006.557205:0:8300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714043648 00000100:00100000:0.0:1782217006.557211:0:8300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714043648 00000100:00100000:0.0:1782217006.557266:0:8300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 5 00000100:00100000:0.0:1782217006.557273:0:8300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e644798850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+40:2359:x1868789714043648:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217006.557286:0:8300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217006.557306:0:8300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f264 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203af expref: 40 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.557325:0:8300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88e67a811d00) 00010000:00010000:0.0:1782217006.557331:0:8300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217006.557413:0:8300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e644798850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+39:2359:x1868789714043648:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 140us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217006.557422:0:8300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 5 00010000:00010000:1.0:1782217006.558179:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f272 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203b6 expref: 39 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.558203:0:6855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f279 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203b6 expref: 38 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.558212:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88e67a811d00) 00010000:00010000:1.0:1782217006.558215:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1782217006.558232:0:6855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd06400, rc 0) 00000100:00100000:1.0:1782217006.558275:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+38:10507:x1868789714043520:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 1664us (1916us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1782217006.558283:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 99 00000100:00100000:2.0:1782217006.566647:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217006.567199:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714043776 00000100:00100000:1.0:1782217006.567214:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714043776 00000100:00100000:1.0:1782217006.567300:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 37 00000100:00100000:1.0:1782217006.567313:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f7a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+8:2359:x1868789714043776:12345-192.168.203.19@tcp:1:lfs.0 00010000:00010000:1.0:1782217006.567385:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b3a3bf3/0xf210a9075089f287 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.567410:0:6580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3d28536/0xf210a9075089f248 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203a1 expref: 8 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.567419:0:6580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217006.567423:0:6580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782217006.567428:0:6580:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b3a3bf3/0xf210a9075089f287 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.567475:0:6580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b3d28536/0xf210a9075089f248 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203a1 expref: 8 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.567491:0:6580:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b3d28536/0xf210a9075089f248 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203a1 expref: 8 pid: 6579 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217006.567508:0:6580:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e649191180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6580:1868789733984000:192.168.203.19@tcp:104: 00000100:00100000:1.0:1782217006.567628:0:6580:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64e380300 going to sleep for 11 seconds 00000100:00100000:1.0:1782217006.572273:0:6580:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e649191180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6580:1868789733984000:192.168.203.19@tcp:104: 00010000:00010000:1.0:1782217006.572317:0:6580:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b3a3bf3/0xf210a9075089f287 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217006.572581:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217006.572816:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714043904 00000100:00100000:0.0:1782217006.572826:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714043904 00002000:00100000:0.0:1782217006.572928:0:6584:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff88e67f7a3800 x1868789714043904/t0(0) o4->10ba4d21-74e8-42e8-8e52-48a327751cbd@192.168.203.19@tcp:257/0 lens 504/0 e 0 to 0 dl 1782217017 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782217006.572940:0:6584:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff88e67f7a3800 with x1868789714043904 ext(0->8) 00010000:00010000:0.0:1782217006.572950:0:6584:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b3d28536/0xf210a9075089f248 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203a1 expref: 9 pid: 6579 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.572967:0:6584:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b3d28536/0xf210a9075089f248 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203a1 expref: 9 pid: 6579 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782217006.572998:0:6584:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88e67f7a3800 00000100:00100000:0.0:1782217006.573043:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 1 00000100:00100000:0.0:1782217006.573161:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f7a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+9:2359:x1868789714043904:12345-192.168.203.19@tcp:4:lfs.0 00000100:00100000:0.0:1782217006.573798:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f7a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+11:2359:x1868789714043904:12345-192.168.203.19@tcp:4:lfs.0 Request processed in 639us (1216us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1782217006.573807:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 1 00002000:00100000:0.0:1782217006.573815:0:6584:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff88e67f7a3800 x1868789714043904/t4294967302(0) o4->10ba4d21-74e8-42e8-8e52-48a327751cbd@192.168.203.19@tcp:257/0 lens 504/448 e 0 to 0 dl 1782217017 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782217006.573824:0:6584:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff88e67f7a3800 with x1868789714043904 ext(0->8) 00010000:00010000:0.0:1782217006.574360:0:6584:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b3d28536/0xf210a9075089f248 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203a1 expref: 11 pid: 6579 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.574392:0:6584:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b3d28536/0xf210a9075089f248 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203a1 expref: 11 pid: 6579 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782217006.574402:0:6584:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88e67f7a3800 00000100:00100000:2.0:1782217006.586182:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217006.586394:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714044032 00000100:00100000:0.0:1782217006.586406:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714044032 00010000:00010000:0.0:1782217006.586461:0:8299:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b3d28536/0xf210a9075089f248 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203a1 expref: 11 pid: 6579 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217006.586513:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 50 00000100:00100000:0.0:1782217006.586524:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652481880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+11:2356:x1868789714044032:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217006.586563:0:8299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1782217006.586586:0:8299:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1782217006.586589:0:8299:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1782217005 00002000:00010000:0.0:1782217006.586591:0:8299:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1782217005 00002000:00010000:0.0:1782217006.586594:0:8299:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1782217005 00010000:00010000:0.0:1782217006.586601:0:8299:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b3d28536/0xf210a9075089f248 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203a1 expref: 11 pid: 6579 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.586618:0:8299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b3d28536/0xf210a9075089f248 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203a1 expref: 11 pid: 6579 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.586651:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3d28536/0xf210a9075089f248 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203a1 expref: 11 pid: 6579 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.586673:0:8299:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782217006.586678:0:8299:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782217006.586685:0:8299:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b3a3bf3/0xf210a9075089f287 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.586695:0:8299:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b3a3bf3/0xf210a9075089f287 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.586811:0:8299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217006.587117:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652481880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+10:2356:x1868789714044032:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 591us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217006.587125:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 50 00010000:00010000:1.0:1782217006.590707:0:6580:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b3a3bf3/0xf210a9075089f287 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.590733:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b3a3bf3/0xf210a9075089f287 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.590785:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b3a3bf3/0xf210a9075089f287 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.590795:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b3a3bf3/0xf210a9075089f287 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.590804:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b3a3bf3/0xf210a9075089f287 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.590813:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07a00 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:1.0:1782217006.590818:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b3a3bf3/0xf210a9075089f287 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.590828:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b3a3bf3/0xf210a9075089f287 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.591040:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b3a3bf3/0xf210a9075089f287 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.591050:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b3a3bf3/0xf210a9075089f287 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217006.591279:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f7a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+9:2359:x1868789714043776:12345-192.168.203.19@tcp:1:lfs.0 Request processed in 23961us (24638us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217006.591290:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 37 00000100:00100000:2.0:1782217006.596596:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217006.599170:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714044288 00000100:00100000:1.0:1782217006.599190:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714044288 00000100:00100000:1.0:1782217006.599326:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 26 00000100:00100000:1.0:1782217006.599338:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664ed2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+38:10507:x1868789714044288:12345-192.168.203.19@tcp:35:lfs.0 00000004:00010000:1.0:1782217006.599539:0:5787:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f279 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203b6 expref: 38 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782217006.599949:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1782217006.599987:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1782217006.602952:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1782217006.603066:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f28e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.603093:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f233 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620393 expref: 42 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.603103:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f28e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.603174:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f233 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620393 expref: 42 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.603195:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f233 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620393 expref: 42 pid: 5783 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217006.603213:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e649191180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5787:1868789733984128:192.168.203.19@tcp:104: 00000100:00100000:1.0:1782217006.603329:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64e380240 going to sleep for 11 seconds 00000100:00100000:1.0:1782217006.607468:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e649191180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5787:1868789733984128:192.168.203.19@tcp:104: 00010000:00010000:1.0:1782217006.607514:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f28e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217006.607943:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217006.608023:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714044416 00000100:00100000:1.0:1782217006.608032:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714044416 00010000:00010000:1.0:1782217006.608077:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f233 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620393 expref: 43 pid: 5783 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217006.608112:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 51 00000100:00100000:1.0:1782217006.608123:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652483100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+43:2358:x1868789714044416:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782217006.608142:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217006.608149:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f233 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620393 expref: 43 pid: 5783 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.608162:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f233 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620393 expref: 43 pid: 5783 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.608212:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f233 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620393 expref: 43 pid: 5783 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.608230:0:5768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88e67a811d00) 00010000:00010000:1.0:1782217006.608236:0:5768:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f28e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.608246:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f28e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.608254:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f28e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.608290:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782217006.608356:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652483100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+42:2358:x1868789714044416:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 234us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217006.608376:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 51 00010000:00010000:3.0:1782217006.608814:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f28e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.608825:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f28e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782217006.609045:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1782217006.609294:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1782217006.609468:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664486680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5787:1868789733984256:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1782217006.609855:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217006.610057:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e642ba3480 going to sleep for 11 seconds 00000100:00100000:0.0:1782217006.613054:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733984256 00000100:00100000:0.0:1782217006.613074:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733984256 00000100:00100000:0.0:1782217006.613242:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782217006.613255:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5787:x1868789733984256:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1782217006.613495:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5787:x1868789733984256:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 241us (3638us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217006.613505:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782217006.619012:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664486680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5787:1868789733984256:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1782217006.619643:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1782217006.619752:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664486680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5787:1868789733984384:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1782217006.619847:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217006.619915:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e642ba3840 going to sleep for 11 seconds 00000100:00100000:0.0:1782217006.620013:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733984384 00000100:00100000:0.0:1782217006.620022:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733984384 00000100:00100000:0.0:1782217006.620090:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782217006.620101:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5787:x1868789733984384:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1782217006.620322:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5787:x1868789733984384:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 221us (474us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1782217006.620331:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782217006.620445:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664486680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5787:1868789733984384:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1782217006.620510:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1782217006.620555:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f28e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.620566:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f28e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.620575:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f28e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.620581:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07a00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217006.620594:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f28e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.620603:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f28e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.620624:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88e67a811d00) 00010000:00010000:3.0:1782217006.620627:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1782217006.620633:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f28e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.620640:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f28e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782217006.620842:0:5787:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1782217006.621004:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1782217006.621018:0:5787:0:(osp_sync.c:1862:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 325673139852ns, next at 326673137692ns, rc = 0 00000001:00080000:3.0:1782217006.621024:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1782217006.621056:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88e67a811d00) 00010000:00010000:3.0:1782217006.621060:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1782217006.621069:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f279 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203b6 expref: 46 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217006.621184:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664ed2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+45:10507:x1868789714044288:12345-192.168.203.19@tcp:35:lfs.0 Request processed in 21848us (24604us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1782217006.621193:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 26 00000020:00080000:3.0:1782217006.621197:0:5787:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:1.0:1782217006.622538:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782217006.629516:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217006.629859:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714044544 00000100:00100000:1.0:1782217006.629989:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714044544 00000100:00100000:1.0:1782217006.630091:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 100 00000100:00100000:1.0:1782217006.630104:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+45:10507:x1868789714044544:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:1.0:1782217006.630136:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217006.630165:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f295 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6203bd expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.630246:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f295 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203bd expref: 46 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.630284:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f295 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203bd expref: 46 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.630309:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88e67a811b00) 00010000:00010000:1.0:1782217006.630313:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782217006.630318:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd06c00, rc 0) 00000100:00100000:1.0:1782217006.630523:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+46:10507:x1868789714044544:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 421us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217006.630532:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 100 00000100:00100000:0.0:1782217006.640548:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217006.640640:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714044800 00000100:00100000:3.0:1782217006.640653:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714044800 00000100:00100000:3.0:1782217006.640757:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 27 00000100:00100000:3.0:1782217006.640767:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+46:10507:x1868789714044800:12345-192.168.203.19@tcp:35:lfs.0 00000100:00100000:0.0:1782217006.641560:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+47:10507:x1868789714044800:12345-192.168.203.19@tcp:35:lfs.0 Request processed in 790us (1022us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1782217006.641570:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 27 00010000:00010000:2.0:1782217006.678006:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782217006.718039:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217006.718181:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714044928 00000100:00100000:1.0:1782217006.718195:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714044928 00000100:00100000:1.0:1782217006.718276:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 101 00000100:00100000:1.0:1782217006.718288:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652500a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+47:10517:x1868789714044928:12345-192.168.203.19@tcp:34:lfs.0 00010000:00010000:1.0:1782217006.718414:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f29c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.718436:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f29c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.718451:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f29c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.718469:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f2a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.718476:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f2a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.718505:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f2a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.718641:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f2aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.718650:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f2aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.718657:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f2aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782217006.718712:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f2aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.718728:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f29c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.718735:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f29c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.718742:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f29c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.718749:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217006.718754:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f29c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.718762:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f29c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.718777:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88e650a64700) 00010000:00010000:1.0:1782217006.718787:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217006.718793:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f29c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.718800:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f29c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.718818:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f2a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.718824:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f2a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.718830:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f2a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.718835:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07e00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217006.718838:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f2a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.718844:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f2a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.718852:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88e67a811900) 00010000:00010000:1.0:1782217006.718854:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217006.718856:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f2a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.718861:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f2a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.720270:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f2aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.720302:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f2aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.720310:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f2aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.720316:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217006.720321:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f2aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.720330:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f2aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.720347:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88e67a811b00) 00010000:00010000:1.0:1782217006.720351:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217006.720355:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f2aa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.720361:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f2aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217006.720495:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652500a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+47:10517:x1868789714044928:12345-192.168.203.19@tcp:34:lfs.0 Request processed in 2204us (2469us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217006.720507:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 101 00000100:00100000:0.0:1782217006.773835:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217006.775392:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714045184 00000100:00100000:3.0:1782217006.775414:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714045184 00000100:00100000:3.0:1782217006.775500:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 102 00000100:00100000:3.0:1782217006.775513:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+47:10520:x1868789714045184:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:3.0:1782217006.775543:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217006.775572:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a9075089f2b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6203c4 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.775679:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f2b8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.775699:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f2b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.775712:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f2b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.775730:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f2bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.775737:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f2bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.775744:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f2bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.775952:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f2c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.775961:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f2c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.775987:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f2c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217006.776001:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1782217006.776474:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f2b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.776484:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f2b8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.776491:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f2b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.776498:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e653161200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217006.776504:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f2b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.776512:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f2b8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.776528:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88e650a64700) 00010000:00010000:3.0:1782217006.776532:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217006.776538:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f2b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.776545:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f2b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.776560:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f2bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.776566:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f2bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.776580:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f2bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.776586:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e653161c00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217006.776589:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f2bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.776596:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f2bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.776604:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88e650a64200) 00010000:00010000:3.0:1782217006.776607:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217006.776610:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f2bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.776616:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f2bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.776671:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a9075089f2b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203c4 expref: 50 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.776687:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f2c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203c4 expref: 49 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.776695:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88e67a811b00) 00010000:00010000:3.0:1782217006.776697:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782217006.776700:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e653160e00, rc 0) 00000100:00100000:3.0:1782217006.776801:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+49:10520:x1868789714045184:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 1290us (2980us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1782217006.776821:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 102 00000100:00100000:0.0:1782217006.785276:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217006.785385:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714045312 00000100:00100000:3.0:1782217006.785525:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714045312 00000100:00100000:3.0:1782217006.785726:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 103 00000100:00100000:3.0:1782217006.785740:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+49:10520:x1868789714045312:12345-192.168.203.19@tcp:54:lfs.0 00010000:00010000:3.0:1782217006.785835:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f2d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.785858:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f2d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.786043:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f2d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.786078:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f2d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.786086:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f2d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.786094:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f2d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.786102:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e653160400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217006.786107:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f2d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.786115:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f2d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.786128:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88e67a811b00) 00010000:00010000:3.0:1782217006.786149:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782217006.786156:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f2d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.786162:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f2d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217006.786261:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+49:10520:x1868789714045312:12345-192.168.203.19@tcp:54:lfs.0 Request processed in 523us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217006.786270:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 103 00000100:00100000:2.0:1782217006.790438:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217006.790549:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714045568 00000100:00100000:0.0:1782217006.790563:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714045568 00000100:00100000:0.0:1782217006.790646:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 28 00000100:00100000:0.0:1782217006.790657:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+49:10520:x1868789714045568:12345-192.168.203.19@tcp:35:lfs.0 00000100:00100000:0.0:1782217006.791013:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+50:10520:x1868789714045568:12345-192.168.203.19@tcp:35:lfs.0 Request processed in 356us (587us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1782217006.791042:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 28 00000100:00100000:3.0:1782217006.870118:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217006.870694:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714045824 00000100:00100000:0.0:1782217006.870709:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714045824 00000100:00100000:0.0:1782217006.870791:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 104 00000100:00100000:0.0:1782217006.870804:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+50:10530:x1868789714045824:12345-192.168.203.19@tcp:101:bash.0 00010000:00010000:0.0:1782217006.870836:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217006.870839:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1782217006.870902:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f256 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203a8 expref: 50 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.870929:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88e650a64700) 00010000:00010000:0.0:1782217006.870935:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782217006.870952:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f2db lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6203cb expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.871080:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f2e2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.871097:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f2c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203c4 expref: 50 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.871107:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f2e2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.871167:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f2c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203c4 expref: 50 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.871182:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f2c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203c4 expref: 50 pid: 5785 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217006.871217:0:5785:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1868789733984512:192.168.203.19@tcp:104: 00000100:00100000:0.0:1782217006.871431:0:5785:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e679faaa80 going to sleep for 11 seconds 00000100:00100000:1.0:1782217006.892866:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217006.893044:0:5785:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1868789733984512:192.168.203.19@tcp:104: 00010000:00010000:0.0:1782217006.893081:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f2e2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217006.893170:0:8300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714045952 00000100:00100000:2.0:1782217006.893180:0:8300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714045952 00010000:00010000:2.0:1782217006.893229:0:8300:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f2c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203c4 expref: 51 pid: 5785 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217006.893266:0:8300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 52 00000100:00100000:2.0:1782217006.893274:0:8300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649191180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+51:2358:x1868789714045952:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217006.893293:0:8300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217006.893302:0:8300:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f2c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203c4 expref: 51 pid: 5785 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217006.893327:0:8300:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f2c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203c4 expref: 51 pid: 5785 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217006.893355:0:8300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f2c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203c4 expref: 51 pid: 5785 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217006.893392:0:8300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88e67a811b00) 00010000:00010000:2.0:1782217006.893398:0:8300:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f2e2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217006.893411:0:8300:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f2e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217006.893420:0:8300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f2e2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217006.893452:0:8300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782217006.893548:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f2e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.893555:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f2e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217006.893578:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1782217006.893803:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f2db lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203cb expref: 52 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.893820:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f2e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203cb expref: 51 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.893828:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88e67a811b00) 00010000:00010000:0.0:1782217006.893830:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782217006.893833:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437a000, rc 0) 00000100:00100000:0.0:1782217006.893902:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+51:10530:x1868789714045824:12345-192.168.203.19@tcp:101:bash.0 Request processed in 23076us (23773us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1782217006.893911:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 104 00000100:00100000:2.0:1782217006.894129:0:8300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649191180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+50:2358:x1868789714045952:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 853us (1277us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217006.894138:0:8300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 52 00000100:00100000:2.0:1782217006.899696:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217006.900008:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714046208 00000100:00100000:1.0:1782217006.900021:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714046208 00000100:00100000:1.0:1782217006.900097:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 105 00000100:00100000:1.0:1782217006.900109:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+50:10530:x1868789714046208:12345-192.168.203.19@tcp:36:bash.0 00010000:00010000:1.0:1782217006.900483:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f2f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.900505:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f2f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.900518:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f2f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782217006.900582:0:5784:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1782217006.900609:0:5784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000df0be00 reply state 00000000a9415fe2 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f2f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217006.900619:0:5784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782217006.901685:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+53:10530:x1868789714046208:12345-192.168.203.19@tcp:36:bash.0 Request processed in 1570us (1995us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1782217006.901697:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 105 00000020:00080000:1.0:1782217006.901706:0:5784:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1782217006.906093:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f2f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.906148:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f2f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.906157:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f2f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.906165:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217006.906171:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f2f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.906180:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f2f0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.906202:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88e67a811b00) 00010000:00010000:0.0:1782217006.906205:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217006.906210:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f2f0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.906217:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f2f0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217006.919666:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217006.920065:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714046336 00000100:00100000:1.0:1782217006.920078:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714046336 00000100:00100000:1.0:1782217006.920166:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 106 00000100:00100000:1.0:1782217006.920178:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+52:10530:x1868789714046336:12345-192.168.203.19@tcp:101:bash.0 00010000:00010000:1.0:1782217006.920209:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217006.920234:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f2f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6203d2 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.920341:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f2fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.920358:0:5783:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f2e2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203cb expref: 53 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.920395:0:5783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f2fe lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.920440:0:5783:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f2e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203cb expref: 53 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217006.920456:0:5783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f2e2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203cb expref: 53 pid: 5785 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217006.920473:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e649191500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5783:1868789733984640:192.168.203.19@tcp:104: 00000100:00100000:1.0:1782217006.920584:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64e380d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782217006.924562:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e649191500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5783:1868789733984640:192.168.203.19@tcp:104: 00010000:00010000:3.0:1782217006.924596:0:5783:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f2fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217006.927104:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217006.927668:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714046464 00000100:00100000:0.0:1782217006.927682:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714046464 00010000:00010000:0.0:1782217006.927737:0:8299:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f2e2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203cb expref: 54 pid: 5785 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217006.927789:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 53 00000100:00100000:0.0:1782217006.927800:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a817100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+54:2358:x1868789714046464:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217006.927819:0:8299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217006.927844:0:8299:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f2e2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203cb expref: 54 pid: 5785 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.927925:0:8299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f2e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203cb expref: 54 pid: 5785 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.927957:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f2e2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203cb expref: 54 pid: 5785 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.927977:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88e67a811b00) 00010000:00010000:0.0:1782217006.927983:0:8299:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f2fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.927995:0:8299:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f2fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.928005:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f2fe lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217006.928037:0:8299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782217006.928095:0:5783:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f2fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217006.928111:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a817100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+53:2358:x1868789714046464:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 308us (1016us total) trans 0 rc 0/0 00010000:00010000:3.0:1782217006.928128:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f2fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217006.928195:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1782217006.928200:0:5783:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782217006.928221:0:5783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f2fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.928262:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f2f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203d2 expref: 54 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.928285:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f2fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203d2 expref: 53 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217006.928315:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88e67a811b00) 00010000:00010000:3.0:1782217006.928318:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782217006.928321:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd07600, rc 0) 00000100:00100000:3.0:1782217006.928393:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+53:10530:x1868789714046336:12345-192.168.203.19@tcp:101:bash.0 Request processed in 8216us (8753us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217006.928403:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 106 00000100:00100000:0.0:1782217006.929248:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 53 00000100:00100000:1.0:1782217006.936814:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217006.937063:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714046720 00000100:00100000:0.0:1782217006.937077:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714046720 00000100:00100000:0.0:1782217006.937249:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 29 00000100:00100000:0.0:1782217006.937263:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+52:10530:x1868789714046720:12345-192.168.203.19@tcp:35:bash.0 00000100:00100000:0.0:1782217006.937613:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+53:10530:x1868789714046720:12345-192.168.203.19@tcp:35:bash.0 Request processed in 352us (813us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1782217006.937645:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 29 00000100:00100000:2.0:1782217007.000029:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217007.000180:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714046848 00000100:00100000:3.0:1782217007.000193:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714046848 00000100:00100000:3.0:1782217007.000273:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 107 00000100:00100000:3.0:1782217007.000286:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+53:10536:x1868789714046848:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:3.0:1782217007.000322:0:6855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217007.000349:0:6855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f305 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6203d9 expref: -99 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.000447:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a9075089f30c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.000464:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a9075089f30c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.000481:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a9075089f30c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217007.000561:0:6855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1782217007.000566:0:6855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1782217007.000595:0:6855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a9075089f30c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.000650:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f305 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203d9 expref: 55 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.000809:0:6855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a9075089f30c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203d9 expref: 54 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.000820:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88e650a64700) 00010000:00010000:3.0:1782217007.000823:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782217007.000828:0:6855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e653161600, rc 0) 00000100:00100000:3.0:1782217007.000965:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+54:10536:x1868789714046848:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 681us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217007.000973:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 107 00000100:00100000:1.0:1782217007.003729:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217007.003844:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714046976 00000100:00100000:0.0:1782217007.003857:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714046976 00000100:00100000:0.0:1782217007.003963:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 108 00000100:00100000:0.0:1782217007.003976:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+54:10536:x1868789714046976:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:0.0:1782217007.004002:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217007.004026:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f313 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6203e0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.004136:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f31a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.004154:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f31a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.004167:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f31a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.004183:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f321 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.004190:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f321 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.004197:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f321 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.004321:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089f328 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.004356:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089f328 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.004373:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089f328 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217007.004417:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1782217007.004422:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782217007.004445:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089f328 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.004459:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089f328 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.004469:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f31a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.004476:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f31a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.004483:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f31a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.004489:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437b200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217007.004494:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f31a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.004502:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f31a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.004517:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88e650a64700) 00010000:00010000:0.0:1782217007.004521:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217007.004535:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f31a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.004542:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f31a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.004559:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f321 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.004565:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f321 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.004571:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f321 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.004576:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437bc00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217007.004580:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f321 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.004586:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f321 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.004595:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88e647d05000) 00010000:00010000:0.0:1782217007.004597:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217007.004600:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f321 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.004606:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f321 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.004642:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f313 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203e0 expref: 56 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.004669:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089f328 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203e0 expref: 55 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.004677:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88e67a811b00) 00010000:00010000:0.0:1782217007.004680:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782217007.004682:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437ba00, rc 0) 00000100:00100000:0.0:1782217007.004768:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+55:10536:x1868789714046976:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 795us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217007.004777:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 108 00000100:00100000:1.0:1782217007.009406:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217007.009559:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714047360 00000100:00100000:2.0:1782217007.009573:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714047360 00000100:00100000:2.0:1782217007.009650:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 6 00000100:00100000:2.0:1782217007.009673:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649190a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+55:2358:x1868789714047360:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217007.009693:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217007.009726:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089f328 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203e0 expref: 55 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217007.009748:0:5768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88e67a811b00) 00010000:00010000:2.0:1782217007.009754:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217007.009826:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649190a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+54:2358:x1868789714047360:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 155us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217007.009835:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 6 00000100:00100000:2.0:1782217007.011753:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217007.012034:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714047232 00000100:00100000:1.0:1782217007.012044:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714047232 00000100:00100000:1.0:1782217007.012109:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 109 00000100:00100000:1.0:1782217007.012120:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+54:10536:x1868789714047232:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:1.0:1782217007.012147:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217007.012173:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f32f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6203e7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.012295:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f336 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.012311:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f2fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203d2 expref: 55 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.012344:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f336 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.012406:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f2fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203d2 expref: 55 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.012420:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f2fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203d2 expref: 55 pid: 5783 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217007.012435:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e649190380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5784:1868789733984768:192.168.203.19@tcp:104: 00000100:00100000:1.0:1782217007.012706:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64e380240 going to sleep for 11 seconds 00000100:00100000:2.0:1782217007.015072:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e649190380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5784:1868789733984768:192.168.203.19@tcp:104: 00010000:00010000:2.0:1782217007.015114:0:5784:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f336 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217007.016589:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217007.016691:0:8300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714047488 00000100:00100000:0.0:1782217007.016702:0:8300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714047488 00010000:00010000:0.0:1782217007.016756:0:8300:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f2fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203d2 expref: 56 pid: 5783 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217007.016802:0:8300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 54 00000100:00100000:0.0:1782217007.016813:0:8300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a814380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+56:2359:x1868789714047488:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217007.016831:0:8300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217007.016839:0:8300:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f2fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203d2 expref: 56 pid: 5783 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.016852:0:8300:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f2fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203d2 expref: 56 pid: 5783 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.016918:0:8300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f2fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203d2 expref: 56 pid: 5783 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.016960:0:8300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88e67a811b00) 00010000:00010000:0.0:1782217007.016965:0:8300:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f336 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.016976:0:8300:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f336 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.016985:0:8300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f336 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.017019:0:8300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217007.017080:0:8300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a814380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+55:2359:x1868789714047488:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 269us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217007.017088:0:8300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 54 00010000:00010000:2.0:1782217007.017913:0:5784:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f336 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217007.017935:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f336 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217007.017961:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1782217007.018160:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f32f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203e7 expref: 56 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217007.018181:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f336 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203e7 expref: 55 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217007.018190:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88e67a811b00) 00010000:00010000:2.0:1782217007.018193:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782217007.018196:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd07a00, rc 0) 00000100:00100000:2.0:1782217007.018257:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+55:10536:x1868789714047232:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 6138us (6516us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1782217007.018266:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 109 00000100:00100000:2.0:1782217007.022082:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217007.022174:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714047744 00000100:00100000:0.0:1782217007.022186:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714047744 00000100:00100000:0.0:1782217007.022261:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 7 00000100:00100000:0.0:1782217007.022273:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64479a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+55:10536:x1868789714047744:12345-192.168.203.19@tcp:103:lfs.0 00010000:00010000:0.0:1782217007.022291:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217007.022323:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f295 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203bd expref: 55 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.022359:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88e67a811b00) 00010000:00010000:0.0:1782217007.022375:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217007.022447:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64479a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+54:10536:x1868789714047744:12345-192.168.203.19@tcp:103:lfs.0 Request processed in 176us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217007.022456:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 7 00000100:00100000:1.0:1782217007.025029:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217007.025145:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714047872 00000100:00100000:0.0:1782217007.025158:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714047872 00000100:00100000:0.0:1782217007.025233:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 110 00000100:00100000:0.0:1782217007.025246:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+54:10536:x1868789714047872:12345-192.168.203.19@tcp:58:lfs.0 00010000:00010000:0.0:1782217007.025445:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f344 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.025466:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f344 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.025493:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f344 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782217007.025750:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1782217007.026000:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+54:10536:x1868789714047872:12345-192.168.203.19@tcp:58:lfs.0 Request processed in 634us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217007.026010:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 110 00000100:00100000:2.0:1782217007.029336:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217007.029652:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714048000 00000100:00100000:3.0:1782217007.029669:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714048000 00000100:00100000:3.0:1782217007.029747:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 111 00000100:00100000:3.0:1782217007.029759:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+54:10536:x1868789714048000:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:3.0:1782217007.029787:0:6855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217007.029813:0:6855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f34b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6203ee expref: -99 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.029935:0:6855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f344 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.029948:0:6855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f34b lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203ee expref: 55 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.029970:0:6855:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f344 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.030000:0:6855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f34b lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203ee expref: 55 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.030015:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88e67a811b00) 00010000:00010000:3.0:1782217007.030019:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782217007.030022:0:6855:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f34b lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203ee expref: 55 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.030030:0:6855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e653160400, rc 0) 00000100:00100000:3.0:1782217007.030090:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+55:10536:x1868789714048000:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 334us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217007.030097:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 111 00000040:00080000:3.0:1782217007.252228:0:11532:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782217007.252242:0:11532:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782217007.252288:0:11532:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1782217007.252296:0:11532:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782217007.252493:0:11532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664484380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11532:1868789733984896:192.168.203.19@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782217007.252831:0:11532:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e642ba3780 going to sleep for 11 seconds 00000100:00100000:2.0:1782217007.267045:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217007.267399:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714048128 00000100:00100000:0.0:1782217007.267411:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714048128 00000100:00100000:0.0:1782217007.267496:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 112 00000100:00100000:0.0:1782217007.267518:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+56:10537:x1868789714048128:12345-192.168.203.19@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782217007.267573:0:5785:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1782217007.267629:0:11532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664484380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11532:1868789733984896:192.168.203.19@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1782217007.267713:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+55:10537:x1868789714048128:12345-192.168.203.19@tcp:53:lhsmtool_posix.0 Request processed in 205us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217007.267721:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 112 00000100:00100000:2.0:1782217007.280672:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217007.281220:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714048256 00000100:00100000:3.0:1782217007.281234:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714048256 00000100:00100000:3.0:1782217007.281309:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 113 00000100:00100000:3.0:1782217007.281321:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+55:10537:x1868789714048256:12345-192.168.203.19@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1782217007.281439:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f352 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.281484:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f352 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.281508:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f352 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.283436:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f359 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.283457:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f359 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.283469:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f359 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.283503:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f360 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.283511:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f360 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.283518:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f360 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217007.283562:0:6855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1782217007.283567:0:6855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782217007.283580:0:6855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f360 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.283593:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f352 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.283616:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f352 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.283623:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f352 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.283628:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e653161c00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217007.283632:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f352 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.283640:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f352 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.283652:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88e67a811700) 00010000:00010000:3.0:1782217007.283655:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217007.283659:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f352 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.283665:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f352 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.283680:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f359 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.283685:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f359 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.283690:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f359 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.283694:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e653161200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217007.283703:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f359 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.283709:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f359 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.283716:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff88e650a64200) 00010000:00010000:3.0:1782217007.283718:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217007.283721:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f359 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.283726:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f359 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.283738:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f360 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.283744:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f360 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.283750:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f360 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.283754:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e653160e00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217007.283757:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f360 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.283762:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f360 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.283768:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88e67a811b00) 00010000:00010000:3.0:1782217007.283769:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217007.283777:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f360 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.283782:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f360 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217007.283931:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+55:10537:x1868789714048256:12345-192.168.203.19@tcp:34:lhsmtool_posix.0 Request processed in 2606us (3268us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217007.283941:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 113 00000100:00100000:2.0:1782217007.289568:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217007.290006:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714048512 00000100:00100000:0.0:1782217007.290016:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714048512 00000100:00100000:0.0:1782217007.290063:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 114 00000100:00100000:0.0:1782217007.290072:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a817100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+55:10537:x1868789714048512:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782217007.290103:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217007.290122:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f367 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6203f5 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.290465:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f36e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.290480:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f36e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.290492:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f36e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217007.290504:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1782217007.290608:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f36e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.290615:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f36e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.290620:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f36e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.290625:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437b200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217007.290629:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f36e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.290636:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f36e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.290647:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88e67a811b00) 00010000:00010000:0.0:1782217007.290655:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782217007.290660:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f36e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.290665:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f36e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.290707:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f367 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203f5 expref: 57 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.290717:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88e67a811700) 00010000:00010000:0.0:1782217007.290719:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782217007.290722:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f367 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203f5 expref: 57 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.290731:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437bc00, rc 0) 00000100:00100000:0.0:1782217007.291310:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a817100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+56:10537:x1868789714048512:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 1235us (1748us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1782217007.291320:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 114 00000100:00100000:1.0:1782217007.298824:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217007.298915:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714048640 00000100:00100000:3.0:1782217007.298925:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714048640 00000100:00100000:3.0:1782217007.298980:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 115 00000100:00100000:3.0:1782217007.298990:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649190700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+56:10537:x1868789714048640:12345-192.168.203.19@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1782217007.299025:0:6855:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1782217007.299123:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649190700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+56:10537:x1868789714048640:12345-192.168.203.19@tcp:53:lhsmtool_posix.0 Request processed in 133us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217007.299131:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 115 00000100:00100000:2.0:1782217007.310551:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217007.310661:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714048896 00000100:00100000:0.0:1782217007.310671:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714048896 00000100:00100000:0.0:1782217007.310740:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 116 00000100:00100000:0.0:1782217007.310750:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+56:10537:x1868789714048896:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782217007.310770:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217007.310773:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1782217007.310800:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a9075089f30c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203d9 expref: 56 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.310820:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88e650a64700) 00010000:00010000:0.0:1782217007.310833:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782217007.310846:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f37c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6203fc expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782217007.311306:0:5785:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1782217007.311530:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f383 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.311543:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f383 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.311553:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f383 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.311608:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f37c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203fc expref: 58 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.311624:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f383 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203fc expref: 57 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.311632:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88e647d05000) 00010000:00010000:0.0:1782217007.311635:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782217007.311637:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437b200, rc 0) 00000100:00100000:0.0:1782217007.311704:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+57:10537:x1868789714048896:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 954us (1161us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1782217007.311712:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 116 00000100:00100000:2.0:1782217007.337559:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217007.337754:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714049152 00000100:00100000:1.0:1782217007.337764:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714049152 00000100:00100000:1.0:1782217007.337824:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 117 00000100:00100000:1.0:1782217007.337835:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+57:10537:x1868789714049152:12345-192.168.203.19@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782217007.337935:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217007.337959:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f383 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203fc expref: 57 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.337976:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88e647d05000) 00010000:00010000:1.0:1782217007.337986:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782217007.338005:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f391 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.338047:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f391 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.338057:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f391 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.338072:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f398 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x66c4f294 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.338079:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f398 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x66c4f294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.338084:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f398 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x66c4f294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.338154:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f391 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.338162:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f391 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.338169:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f391 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.338174:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217007.338179:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f391 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.338186:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f391 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.338194:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88e650a64700) 00010000:00010000:1.0:1782217007.338202:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217007.338207:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f391 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.338214:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f391 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.338225:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f398 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x66c4f294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.338230:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f398 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x66c4f294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.338235:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f398 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x66c4f294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.338240:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217007.338243:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f398 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x66c4f294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.338248:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f398 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x66c4f294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.338256:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x66c4f294 (ffff88e67a811900) 00010000:00010000:1.0:1782217007.338258:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217007.338261:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f398 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x66c4f294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.338267:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f398 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x66c4f294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217007.338371:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+56:10537:x1868789714049152:12345-192.168.203.19@tcp:36:lhsmtool_posix.0 Request processed in 528us (810us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782217007.338385:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 117 00000100:00100000:2.0:1782217007.347287:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217007.347561:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714049280 00000100:00100000:0.0:1782217007.347571:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714049280 00000100:00100000:0.0:1782217007.347629:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 118 00000100:00100000:0.0:1782217007.347639:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+56:10537:x1868789714049280:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782217007.347674:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217007.347697:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f39f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620403 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.347746:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f3a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.347757:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f3a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.347767:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f3a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.347856:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f39f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620403 expref: 58 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.347872:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f3a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620403 expref: 57 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.347910:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88e647d05d00) 00010000:00010000:0.0:1782217007.347912:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782217007.347915:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437a600, rc 0) 00000100:00100000:0.0:1782217007.347966:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+57:10537:x1868789714049280:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 328us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217007.347973:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 118 00000100:00100000:2.0:1782217007.353265:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217007.354417:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714049536 00000100:00100000:1.0:1782217007.354429:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714049536 00000100:00100000:1.0:1782217007.354494:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 119 00000100:00100000:1.0:1782217007.354505:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+57:10537:x1868789714049536:12345-192.168.203.19@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782217007.354582:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f3ad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.354597:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f3ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.354609:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f3ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782217007.354847:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:1.0:1782217007.354856:0:5784:0:(osp_sync.c:1862:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 326406978635ns, next at 327406976365ns, rc = 0 00000004:00010000:1.0:1782217007.355599:0:5784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000085d1f3b reply state 0000000085db2846 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f3ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217007.355611:0:5784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782217007.355770:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+59:10537:x1868789714049536:12345-192.168.203.19@tcp:36:lhsmtool_posix.0 Request processed in 1265us (2511us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1782217007.355779:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 119 00010000:00010000:0.0:1782217007.359133:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f3ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.359150:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f3ad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.359172:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f3ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.359179:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217007.359184:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f3ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.359193:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f3ad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.359208:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88e647d05d00) 00010000:00010000:0.0:1782217007.359212:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782217007.359216:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f3ad lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.359222:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f3ad lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217007.361431:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217007.361504:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714049664 00000100:00100000:0.0:1782217007.361514:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714049664 00000100:00100000:0.0:1782217007.361571:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 120 00000100:00100000:0.0:1782217007.361580:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67426d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+58:10537:x1868789714049664:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782217007.361602:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217007.361620:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f3b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62040a expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.361674:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f3b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62040a expref: 59 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.361704:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f3b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62040a expref: 59 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.361724:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88e647d05d00) 00010000:00010000:0.0:1782217007.361726:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782217007.361729:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437bc00, rc 0) 00000100:00100000:0.0:1782217007.361789:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67426d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+59:10537:x1868789714049664:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 210us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217007.361796:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 120 00000100:00100000:2.0:1782217007.372494:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217007.372704:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714049792 00000100:00100000:0.0:1782217007.372713:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714049792 00000100:00100000:0.0:1782217007.372779:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 38 00000100:00100000:0.0:1782217007.372788:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67426d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+8:2358:x1868789714049792:12345-192.168.203.19@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1782217007.373014:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782217007.374228:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67426d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+9:2358:x1868789714049792:12345-192.168.203.19@tcp:2:lhsmtool_posix.0 Request processed in 1435us (1736us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1782217007.374239:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 38 00000100:00100000:2.0:1782217007.382753:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217007.382850:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714050048 00000100:00100000:0.0:1782217007.382859:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714050048 00000100:00100000:0.0:1782217007.382970:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 30 00000100:00100000:0.0:1782217007.383166:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67426dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+59:10537:x1868789714050048:12345-192.168.203.19@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1782217007.383483:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67426dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+60:10537:x1868789714050048:12345-192.168.203.19@tcp:35:lhsmtool_posix.0 Request processed in 504us (738us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1782217007.383492:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 30 00000100:00100000:2.0:1782217007.388401:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217007.388537:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714050304 00000100:00100000:3.0:1782217007.388547:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714050304 00000100:00100000:3.0:1782217007.388601:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 121 00000100:00100000:3.0:1782217007.388610:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a0e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+60:10537:x1868789714050304:12345-192.168.203.19@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1782217007.388716:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a0e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+60:10537:x1868789714050304:12345-192.168.203.19@tcp:57:lhsmtool_posix.0 Request processed in 106us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217007.388724:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 121 00000100:00100000:2.0:1782217007.397415:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217007.397511:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714050432 00000100:00100000:0.0:1782217007.397534:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714050432 00000100:00100000:0.0:1782217007.397592:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 122 00000100:00100000:0.0:1782217007.397601:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a0e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+60:10537:x1868789714050432:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782217007.397622:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217007.397644:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089f3bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620411 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.397712:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f3c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.397726:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f3c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.397737:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f3c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217007.397781:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782217007.397799:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f3c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.397828:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089f3bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620411 expref: 62 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.397846:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f3c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620411 expref: 61 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.397854:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88e647d05d00) 00010000:00010000:0.0:1782217007.397856:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1782217007.397860:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437ae00, rc 0) 00000100:00100000:0.0:1782217007.398227:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a0e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+61:10537:x1868789714050432:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 626us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217007.398242:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 122 00000100:00100000:2.0:1782217007.407473:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217007.407569:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714050560 00000100:00100000:1.0:1782217007.407579:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714050560 00000100:00100000:1.0:1782217007.407636:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 39 00000100:00100000:1.0:1782217007.407647:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a0e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+9:2359:x1868789714050560:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782217007.407680:0:7991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217007.407700:0:7991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8363da8/0xf210a9075089f3c9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620418 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782217007.407725:0:7991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3a792e, blocks: 0x1 00010000:00010000:1.0:1782217007.407744:0:7991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=326s v=(0 0) 00010000:00010000:1.0:1782217007.407748:0:7991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217007.407758:0:7991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8363da8/0xf210a9075089f3c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620418 expref: 10 pid: 7991 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.407775:0:7991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e8363da8/0xf210a9075089f3c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620418 expref: 10 pid: 7991 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.407787:0:7991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd06400, rc 0) 00000100:00100000:1.0:1782217007.407842:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a0e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+10:2359:x1868789714050560:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 196us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217007.407848:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 39 00000100:00100000:2.0:1782217007.416345:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217007.416437:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714050816 00000100:00100000:3.0:1782217007.416447:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714050816 00000100:00100000:3.0:1782217007.416506:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 123 00000100:00100000:3.0:1782217007.416517:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a0e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+61:10537:x1868789714050816:12345-192.168.203.19@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1782217007.416633:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a0e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+61:10537:x1868789714050816:12345-192.168.203.19@tcp:57:lhsmtool_posix.0 Request processed in 117us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217007.416641:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 123 00000100:00100000:2.0:1782217007.425333:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217007.425437:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714050944 00000100:00100000:1.0:1782217007.425447:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714050944 00000100:00100000:1.0:1782217007.425505:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 40 00000100:00100000:1.0:1782217007.425516:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a0e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+10:10537:x1868789714050944:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782217007.425534:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217007.425552:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ebe93e7/0xf210a9075089f3d0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62041f expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.425581:0:6579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e8363da8/0xf210a9075089f3c9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620418 expref: 11 pid: 7991 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.425603:0:6579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217007.425607:0:6579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217007.425612:0:6579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ebe93e7/0xf210a9075089f3d0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62041f expref: 11 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.425645:0:6579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e8363da8/0xf210a9075089f3c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620418 expref: 11 pid: 7991 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.425657:0:6579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e8363da8/0xf210a9075089f3c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620418 expref: 11 pid: 7991 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217007.425670:0:6579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e649191f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6579:1868789733985024:192.168.203.19@tcp:104: 00000100:00100000:1.0:1782217007.425761:0:6579:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64e380240 going to sleep for 11 seconds 00000100:00100000:2.0:1782217007.434602:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217007.434750:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714051072 00000100:00100000:3.0:1782217007.434759:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714051072 00010000:00010000:3.0:1782217007.434800:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e8363da8/0xf210a9075089f3c9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620418 expref: 12 pid: 7991 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217007.434801:0:6579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e649191f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6579:1868789733985024:192.168.203.19@tcp:104: 00010000:00010000:1.0:1782217007.434830:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008ebe93e7/0xf210a9075089f3d0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62041f expref: 12 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217007.434839:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 55 00010000:00010000:1.0:1782217007.434846:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd06c00, rc 0) 00000100:00100000:3.0:1782217007.434848:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a0e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+12:2359:x1868789714051072:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217007.434867:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1782217007.434912:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a0e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+12:10537:x1868789714050944:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 9398us (9589us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217007.434919:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 40 00010000:00010000:3.0:1782217007.434920:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e8363da8/0xf210a9075089f3c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620418 expref: 12 pid: 7991 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.434940:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e8363da8/0xf210a9075089f3c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620418 expref: 12 pid: 7991 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.434964:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8363da8/0xf210a9075089f3c9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620418 expref: 11 pid: 7991 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.434977:0:5768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217007.434980:0:5768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217007.434987:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ebe93e7/0xf210a9075089f3d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62041f expref: 10 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.435016:0:5768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ebe93e7/0xf210a9075089f3d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62041f expref: 10 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.435051:0:5768:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008ebe93e7/0xf210a9075089f3d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62041f expref: 10 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217007.435065:0:5768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664484380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5768:1868789733985152:192.168.203.19@tcp:105: 00000100:00100000:3.0:1782217007.435114:0:5768:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e642ba3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782217007.442970:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217007.443396:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714051200 00000100:00100000:1.0:1782217007.443405:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714051200 00002000:00100000:1.0:1782217007.443453:0:6583:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff88e67a0e2300 x1868789714051200/t0(0) o4->10ba4d21-74e8-42e8-8e52-48a327751cbd@192.168.203.19@tcp:258/0 lens 504/0 e 0 to 0 dl 1782217018 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782217007.443479:0:6583:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff88e67a0e2300 with x1868789714051200 ext(0->12) 00002000:00010000:1.0:1782217007.443486:0:6583:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88e67a0e2300 00000100:00100000:1.0:1782217007.443517:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 2 00000100:00100000:1.0:1782217007.443527:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a0e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+11:2358:x1868789714051200:12345-192.168.203.19@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1782217007.443995:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a0e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+13:2358:x1868789714051200:12345-192.168.203.19@tcp:4:lhsmtool_posix.0 Request processed in 467us (1031us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1782217007.444003:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 2 00002000:00100000:1.0:1782217007.444011:0:6583:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff88e67a0e2300 x1868789714051200/t4294967308(0) o4->10ba4d21-74e8-42e8-8e52-48a327751cbd@192.168.203.19@tcp:258/0 lens 504/448 e 0 to 0 dl 1782217018 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782217007.444468:0:6583:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff88e67a0e2300 with x1868789714051200 ext(0->12) 00002000:00010000:1.0:1782217007.444474:0:6583:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88e67a0e2300 00000100:00100000:3.0:1782217007.444576:0:5768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664484380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5768:1868789733985152:192.168.203.19@tcp:105: 00010000:00010000:3.0:1782217007.444597:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217007.444632:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a0e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+12:2359:x1868789714051072:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 9784us (10040us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217007.444641:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 55 00000100:00100000:2.0:1782217007.458600:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217007.459061:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714051328 00000100:00100000:1.0:1782217007.459071:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714051328 00000100:00100000:1.0:1782217007.459132:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 124 00000100:00100000:1.0:1782217007.459143:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a0e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+61:10537:x1868789714051328:12345-192.168.203.19@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1782217007.539228:0:5805:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:3.0:1782217007.539265:0:5805:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:3.0:1782217007.539281:0:5805:0:(osp_sync.c:1827:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1782217007.539318:0:5805:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88e64e0d30c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1782217007.539323:0:5805:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff88e67fb4b200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88e6805b8600 00000020:00080000:3.0:1782217007.539326:0:5805:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff88e67fb4b700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88e679f81c00 00000100:00100000:1.0:1782217007.539568:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e649191f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733985280:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782217007.539629:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217007.539698:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782217007.539704:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e649191180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733985408:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1782217007.539725:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217007.539756:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733985280 00000100:00100000:1.0:1782217007.539763:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733985280 00000100:00100000:1.0:1782217007.539809:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733985408 00000100:00100000:1.0:1782217007.539823:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733985408 00000100:00100000:1.0:1782217007.539846:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782217007.539853:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649190a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3303:x1868789733985280:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782217007.540069:0:7991:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:1.0:1782217007.540094:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033ea252e/0xf210a9075089f3d7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.540115:0:7991:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000afb2944d/0xf210a9075089f199 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62037e expref: 11 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.540124:0:7991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1782217007.540128:0:7991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782217007.540131:0:7991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033ea252e/0xf210a9075089f3d7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.540171:0:7991:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000afb2944d/0xf210a9075089f199 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62037e expref: 11 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.540185:0:7991:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000afb2944d/0xf210a9075089f199 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62037e expref: 11 pid: 6579 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217007.540197:0:7991:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e649196680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7991:1868789733985536:192.168.203.19@tcp:104: 00000100:00100000:1.0:1782217007.540254:0:7991:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64e380480 going to sleep for 11 seconds 00000100:00100000:1.0:1782217007.540272:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1782217007.540280:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649190380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3303:x1868789733985408:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1782217007.540564:0:5805:0:(osp_sync.c:1827:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:3.0:1782217007.540583:0:5805:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88e642ba3480 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1782217007.540587:0:5805:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff88e6447ae100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88e642ba3900 00000020:00080000:3.0:1782217007.540590:0:5805:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff88e6447aeb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88e67f171000 00000004:00080000:3.0:1782217007.540607:0:5805:0:(osp_sync.c:1827:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1782217007.540709:0:5817:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:2.0:1782217007.541563:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a0e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733985664:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782217007.541609:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1782217007.541820:0:6580:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1782217007.541832:0:6580:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1782217006 00002000:00010000:1.0:1782217007.541834:0:6580:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1782217007.541837:0:6580:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1782217006 -> 1782217006 00002000:00010000:1.0:1782217007.541839:0:6580:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000020:00080000:3.0:1782217007.542044:0:5817:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1782217007.542263:0:6579:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1782217007.542272:0:6579:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1782217007.543430:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649190380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3303:x1868789733985408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3144us (3697us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1782217007.543443:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1782217007.543494:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733985664 00000100:00100000:1.0:1782217007.543501:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733985664 00000100:00100000:1.0:1782217007.543530:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1782217007.543538:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a0e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3301:x1868789733985664:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782217007.543563:0:6580:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:1.0:1782217007.543592:0:6580:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a3a792d, atime: 0x6a3a792d, ctime: 0x6a3a792d, blocks: 0x1 00010000:00010000:1.0:1782217007.543599:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076b26f34/0xf210a9075089f3de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.543613:0:6580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=326s v=(0 0) 00010000:00010000:1.0:1782217007.543617:0:6580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217007.543622:0:6580:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076b26f34/0xf210a9075089f3de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.543635:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076b26f34/0xf210a9075089f3de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.543644:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076b26f34/0xf210a9075089f3de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.543666:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076b26f34/0xf210a9075089f3de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.543685:0:6580:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782217007.544182:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a0e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3301:x1868789733985664:12345-0@lo:6:osp-syn-0-0.0 Request processed in 644us (2572us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1782217007.544189:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:1.0:1782217007.544211:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782217007.544217:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076b26f34/0xf210a9075089f3de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.544224:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07e00 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:1.0:1782217007.544228:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076b26f34/0xf210a9075089f3de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.544236:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076b26f34/0xf210a9075089f3de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.544252:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076b26f34/0xf210a9075089f3de lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.544258:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076b26f34/0xf210a9075089f3de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.544274:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217007.544281:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217007.544283:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782217007.544319:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88e67a0e3b80/2, rc 0, transno 4294967304 00000100:00100000:1.0:1782217007.544325:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a0e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733985664:0@lo:6:osp-syn-0-0.0 00000100:00080000:3.0:1782217007.545255:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782217007.545376:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a0e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+15:10537:x1868789714051328:12345-192.168.203.19@tcp:44:lhsmtool_posix.0 Request processed in 86231us (86779us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217007.545385:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 124 00000004:00080000:2.0:1782217007.547655:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88e649191180/2, rc 0, transno 4294967309 00000100:00100000:2.0:1782217007.547668:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e649191180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733985408:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1782217007.556621:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217007.556699:0:8300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714051456 00000100:00100000:0.0:1782217007.556708:0:8300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714051456 00010000:00010000:0.0:1782217007.556745:0:8300:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000afb2944d/0xf210a9075089f199 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62037e expref: 12 pid: 6579 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217007.556784:0:8300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 56 00000100:00100000:0.0:1782217007.556793:0:8300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a0e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+12:2359:x1868789714051456:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217007.556807:0:8300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217007.556813:0:8300:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000afb2944d/0xf210a9075089f199 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62037e expref: 12 pid: 6579 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.556825:0:8300:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000afb2944d/0xf210a9075089f199 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62037e expref: 12 pid: 6579 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.556848:0:8300:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782217007.556852:0:8300:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782217007.556864:0:8300:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000033ea252e/0xf210a9075089f3d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.556873:0:8300:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033ea252e/0xf210a9075089f3d7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.556917:0:8300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217007.556996:0:8300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a0e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+12:2359:x1868789714051456:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 203us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217007.557003:0:8300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 56 00010000:00010000:1.0:1782217007.557254:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afb2944d/0xf210a9075089f199 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62037e expref: 11 pid: 6579 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217007.557268:0:7991:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e649196680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7991:1868789733985536:192.168.203.19@tcp:104: 00010000:00010000:1.0:1782217007.557290:0:7991:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000033ea252e/0xf210a9075089f3d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.557299:0:7991:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000033ea252e/0xf210a9075089f3d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.557305:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033ea252e/0xf210a9075089f3d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.557314:0:7991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033ea252e/0xf210a9075089f3d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.557320:0:7991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033ea252e/0xf210a9075089f3d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.557350:0:7991:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782217007.557863:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649190a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3303:x1868789733985280:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18008us (18232us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1782217007.557918:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:3.0:1782217007.558124:0:11515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217007.558132:0:11515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033ea252e/0xf210a9075089f3d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.558140:0:11515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07600 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217007.558144:0:11515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033ea252e/0xf210a9075089f3d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.558153:0:11515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033ea252e/0xf210a9075089f3d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.558167:0:11515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033ea252e/0xf210a9075089f3d7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.558174:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033ea252e/0xf210a9075089f3d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.558190:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217007.558192:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217007.558194:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1782217007.559420:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88e649191f80/2, rc 0, transno 4294967310 00000100:00100000:0.0:1782217007.559431:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e649191f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733985280:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782217007.564110:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217007.564265:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714051584 00000100:00100000:3.0:1782217007.564275:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714051584 00000100:00100000:3.0:1782217007.564332:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 44 00000100:00100000:3.0:1782217007.564352:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+11:2359:x1868789714051584:12345-192.168.203.19@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1782217007.603465:0:7488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:2.0:1782217007.603484:0:7488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:2.0:1782217007.603492:0:7488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1782217007.603498:0:7488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:1.0:1782217007.604011:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2359:x1868789714051584:12345-192.168.203.19@tcp:16:lhsmtool_posix.0 Request processed in 39664us (39905us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217007.604024:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 44 00000100:00100000:2.0:1782217007.608520:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217007.608631:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714051840 00000100:00100000:3.0:1782217007.608639:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714051840 00000100:00100000:3.0:1782217007.608702:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 125 00000100:00100000:3.0:1782217007.608712:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a0e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+15:10537:x1868789714051840:12345-192.168.203.19@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782217007.608763:0:6855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217007.608787:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f3c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620411 expref: 15 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.608805:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88e647d05d00) 00010000:00010000:3.0:1782217007.608810:0:6855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782217007.608838:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f3e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.608850:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f3e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.608871:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f3e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782217007.609143:0:6855:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d3c2c61f reply state 000000003e2f41cb transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f3e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217007.609151:0:6855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782217007.609294:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a0e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+16:10537:x1868789714051840:12345-192.168.203.19@tcp:36:lhsmtool_posix.0 Request processed in 582us (783us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1782217007.609319:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 125 00000100:00100000:2.0:1782217007.612740:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217007.612827:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714051968 00000100:00100000:1.0:1782217007.612837:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714051968 00000100:00100000:1.0:1782217007.612921:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 45 00000100:00100000:1.0:1782217007.612932:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a0e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2358:x1868789714051968:12345-192.168.203.19@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1782217007.613179:0:6579:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1782217007.613183:0:6579:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1782217006 -> 1782217006 00002000:00010000:1.0:1782217007.613185:0:6579:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1782217005 00002000:00010000:1.0:1782217007.613187:0:6579:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1782217006 -> 1782217006 00002000:00010000:1.0:1782217007.613189:0:6579:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1782217007.613248:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a0e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:2358:x1868789714051968:12345-192.168.203.19@tcp:2:lhsmtool_posix.0 Request processed in 317us (516us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1782217007.613256:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 45 00010000:00010000:0.0:1782217007.613369:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f3e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.613379:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f3e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.613386:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f3e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.613392:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e653160e00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217007.613397:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f3e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.613406:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f3e5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.613421:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88e647d05d00) 00010000:00010000:0.0:1782217007.613425:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217007.613429:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f3e5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.613435:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f3e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217007.619316:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217007.619448:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714052224 00000100:00100000:0.0:1782217007.619458:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714052224 00000100:00100000:0.0:1782217007.619528:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 126 00000100:00100000:0.0:1782217007.619537:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a0e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+15:10537:x1868789714052224:12345-192.168.203.19@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1782217007.619602:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f3ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.619617:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f3a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620403 expref: 15 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.619626:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f3ec lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.619669:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f3a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620403 expref: 15 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.619682:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f3a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620403 expref: 15 pid: 5785 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217007.619696:0:5785:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1868789733985792:192.168.203.19@tcp:104: 00000100:00100000:0.0:1782217007.619785:0:5785:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e679faa540 going to sleep for 11 seconds 00000100:00100000:3.0:1782217007.625377:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217007.625488:0:5785:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1868789733985792:192.168.203.19@tcp:104: 00010000:00010000:0.0:1782217007.625516:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f3ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217007.628142:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714052352 00000100:00100000:2.0:1782217007.628156:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714052352 00010000:00010000:2.0:1782217007.628203:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f3a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620403 expref: 16 pid: 5785 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217007.628249:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 57 00000100:00100000:2.0:1782217007.628259:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664484380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+16:2358:x1868789714052352:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217007.628287:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217007.628294:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f3a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620403 expref: 16 pid: 5785 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217007.628307:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f3a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620403 expref: 16 pid: 5785 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217007.628328:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f3a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620403 expref: 16 pid: 5785 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217007.628365:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88e647d05d00) 00010000:00010000:2.0:1782217007.628370:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f3ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217007.628379:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f3ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217007.628386:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f3ec lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217007.628418:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217007.628482:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664484380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+15:2358:x1868789714052352:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 224us (3121us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217007.628489:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 57 00010000:00010000:0.0:1782217007.628666:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f3ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.628675:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f3ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.628714:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f3ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.628721:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f3ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.628727:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f3ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.628732:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437aa00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217007.628735:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f3ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.628742:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f3ec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.628750:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88e647d05d00) 00010000:00010000:0.0:1782217007.628753:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1782217007.628757:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f3ec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.628761:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f3ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217007.628802:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a0e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+14:10537:x1868789714052224:12345-192.168.203.19@tcp:55:lhsmtool_posix.0 Request processed in 9266us (9495us total) trans 0 rc -22/-22 00000100:00100000:0.0:1782217007.628809:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 126 00000100:00100000:2.0:1782217007.632688:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217007.632770:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714052480 00000100:00100000:1.0:1782217007.632779:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714052480 00000100:00100000:1.0:1782217007.632835:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 46 00000100:00100000:1.0:1782217007.632845:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a0e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:2359:x1868789714052480:12345-192.168.203.19@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1782217007.632930:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000076b26f34/0xf210a9075089f3f3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.632951:0:7991:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008ebe93e7/0xf210a9075089f3d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62041f expref: 7 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.632971:0:7991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217007.632984:0:7991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782217007.632989:0:7991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076b26f34/0xf210a9075089f3f3 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.633023:0:7991:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008ebe93e7/0xf210a9075089f3d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62041f expref: 7 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.633037:0:7991:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008ebe93e7/0xf210a9075089f3d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62041f expref: 7 pid: 6579 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217007.633051:0:7991:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e649196300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7991:1868789733985920:192.168.203.19@tcp:104: 00000100:00100000:1.0:1782217007.633129:0:7991:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64e380900 going to sleep for 11 seconds 00000100:00100000:3.0:1782217007.637708:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217007.637823:0:7991:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e649196300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7991:1868789733985920:192.168.203.19@tcp:104: 00010000:00010000:1.0:1782217007.637848:0:7991:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000076b26f34/0xf210a9075089f3f3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217007.637990:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714052608 00000100:00100000:0.0:1782217007.637997:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714052608 00010000:00010000:0.0:1782217007.638034:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008ebe93e7/0xf210a9075089f3d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62041f expref: 8 pid: 6579 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217007.638087:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 58 00000100:00100000:0.0:1782217007.638097:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664487480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+8:2359:x1868789714052608:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217007.638114:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217007.638139:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008ebe93e7/0xf210a9075089f3d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62041f expref: 8 pid: 6579 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.638151:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008ebe93e7/0xf210a9075089f3d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62041f expref: 8 pid: 6579 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.638173:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ebe93e7/0xf210a9075089f3d0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62041f expref: 8 pid: 6579 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.638188:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782217007.638192:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782217007.638198:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000076b26f34/0xf210a9075089f3f3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.638206:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076b26f34/0xf210a9075089f3f3 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.638234:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217007.638322:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664487480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:2359:x1868789714052608:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 226us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217007.638329:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 58 00010000:00010000:1.0:1782217007.638538:0:7991:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000076b26f34/0xf210a9075089f3f3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.638548:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076b26f34/0xf210a9075089f3f3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.638572:0:7991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000076b26f34/0xf210a9075089f3f3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.638589:0:7991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076b26f34/0xf210a9075089f3f3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.638597:0:7991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076b26f34/0xf210a9075089f3f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.638604:0:7991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07e00 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:1.0:1782217007.638607:0:7991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076b26f34/0xf210a9075089f3f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.638616:0:7991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076b26f34/0xf210a9075089f3f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.638627:0:7991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076b26f34/0xf210a9075089f3f3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.638635:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076b26f34/0xf210a9075089f3f3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217007.638679:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a0e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2359:x1868789714052480:12345-192.168.203.19@tcp:1:lhsmtool_posix.0 Request processed in 5835us (6000us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217007.638686:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 46 00000100:00100000:3.0:1782217007.642740:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217007.642822:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714052864 00000100:00100000:1.0:1782217007.642831:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714052864 00000100:00100000:1.0:1782217007.642936:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 127 00000100:00100000:1.0:1782217007.642960:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+14:10537:x1868789714052864:12345-192.168.203.19@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1782217007.643033:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f3fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.643050:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f3fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.643062:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f3fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.643269:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f401 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.643280:0:6855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f3b4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62040a expref: 15 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.643288:0:6855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f401 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.643321:0:6855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f3b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62040a expref: 15 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.643333:0:6855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f3b4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62040a expref: 15 pid: 5785 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217007.643367:0:6855:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e649196300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6855:1868789733986048:192.168.203.19@tcp:104: 00000100:00100000:1.0:1782217007.643451:0:6855:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64e380900 going to sleep for 11 seconds 00000100:00100000:2.0:1782217007.649381:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217007.649464:0:8300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714052992 00000100:00100000:0.0:1782217007.649474:0:8300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714052992 00010000:00010000:0.0:1782217007.649510:0:8300:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f3b4 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62040a expref: 16 pid: 5785 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217007.649551:0:8300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 59 00000100:00100000:0.0:1782217007.649560:0:8300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a0e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+16:2359:x1868789714052992:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217007.649576:0:8300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217007.649583:0:8300:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f3b4 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62040a expref: 16 pid: 5785 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.649596:0:8300:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f3b4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62040a expref: 16 pid: 5785 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.649616:0:8300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88e647d05d00) 00010000:00010000:0.0:1782217007.649622:0:8300:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f401 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.649631:0:8300:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f401 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.649638:0:8300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f401 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.649669:0:8300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217007.649724:0:8300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a0e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+16:2359:x1868789714052992:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 164us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217007.649732:0:8300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 59 00010000:00010000:1.0:1782217007.650085:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f3b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62040a expref: 15 pid: 5785 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217007.650124:0:6855:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e649196300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6855:1868789733986048:192.168.203.19@tcp:104: 00010000:00010000:1.0:1782217007.650145:0:6855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f401 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.650153:0:6855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f401 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.650159:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f401 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782217007.650331:0:6855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1782217007.650482:0:6855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1782217007.650530:0:6855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1782217007.650604:0:6855:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e649196300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6855:1868789733986176:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1782217007.650646:0:6855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217007.650682:0:6855:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64e380240 going to sleep for 11 seconds 00000100:00100000:0.0:1782217007.650743:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733986176 00000100:00100000:0.0:1782217007.650756:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733986176 00000100:00100000:0.0:1782217007.650796:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782217007.650804:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6855:x1868789733986176:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1782217007.650911:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6855:x1868789733986176:12345-0@lo:1000:mdt00_003.0 Request processed in 107us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217007.650917:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782217007.651272:0:6855:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1782217007.651278:0:6855:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:1.0:1782217007.651294:0:6855:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88e649191180, transno 4294967309 00000004:00080000:1.0:1782217007.651310:0:6855:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88e649191f80, transno 4294967310 00000100:00100000:1.0:1782217007.651316:0:6855:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e649196300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6855:1868789733986176:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1782217007.651760:0:6855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1782217007.651813:0:6855:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e649196300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6855:1868789733986304:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1782217007.651843:0:6855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217007.652420:0:6855:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64e380900 going to sleep for 11 seconds 00000100:00100000:3.0:1782217007.653571:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733986304 00000100:00100000:3.0:1782217007.653579:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733986304 00000100:00100000:3.0:1782217007.653673:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782217007.653682:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6855:x1868789733986304:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1782217007.654033:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6855:x1868789733986304:12345-0@lo:1000:mdt00_003.0 Request processed in 351us (2188us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1782217007.654041:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782217007.654156:0:6855:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e649196300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6855:1868789733986304:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1782217007.654200:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f401 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.654210:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f401 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.654217:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f401 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.654223:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06600 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217007.654227:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f401 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.654235:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f401 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.654249:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88e647d05d00) 00010000:00010000:1.0:1782217007.654252:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782217007.654255:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f401 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.654261:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f401 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.654285:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f344 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.654291:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f344 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.654297:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f344 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.654310:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437a000 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217007.654314:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f344 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.654320:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f344 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.654327:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88e67a811b00) 00010000:00010000:1.0:1782217007.654329:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782217007.654344:0:6855:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f34b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203ee expref: 18 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.654355:0:6855:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f34b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203ee expref: 18 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.654372:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f34b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203ee expref: 18 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.654399:0:6855:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f34b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203ee expref: 18 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217007.654411:0:6855:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e649194700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6855:1868789733986432:192.168.203.19@tcp:105: 00000100:00100000:1.0:1782217007.654476:0:6855:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64e380900 going to sleep for 11 seconds 00000100:00100000:2.0:1782217007.657620:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217007.657718:0:6855:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e649194700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6855:1868789733986432:192.168.203.19@tcp:105: 00010000:00010000:1.0:1782217007.657745:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f344 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.657769:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f344 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.657802:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f408 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.657814:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f408 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.657823:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f408 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.657832:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f408 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.657838:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f408 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.657843:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f408 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.657848:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06c00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217007.657851:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f408 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.657858:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f408 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.657909:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88e67a811b00) 00010000:00010000:1.0:1782217007.657913:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217007.657916:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f408 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.657928:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f408 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.657939:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f3fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.657944:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f3fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.657950:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f3fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.657955:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07e00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217007.657958:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f3fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.657963:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f3fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.657971:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88e67a811b00) 00010000:00010000:1.0:1782217007.657973:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782217007.657976:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f3fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.657981:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f3fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217007.658192:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+18:10537:x1868789714052864:12345-192.168.203.19@tcp:57:lhsmtool_posix.0 Request processed in 15232us (15459us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1782217007.658201:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 127 00000020:00080000:1.0:1782217007.658215:0:6855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1782217007.658396:0:11532:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782217007.658401:0:11532:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782217007.658921:0:11532:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1782217007.658930:0:11532:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782217007.659648:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714053120 00000100:00100000:3.0:1782217007.659667:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714053120 00000100:00100000:3.0:1782217007.659716:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 31 00000100:00100000:3.0:1782217007.659726:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a0e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+18:10536:x1868789714053120:12345-192.168.203.19@tcp:49:lfs.0 00000100:00100000:3.0:1782217007.659839:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a0e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+18:10536:x1868789714053120:12345-192.168.203.19@tcp:49:lfs.0 Request processed in 114us (2228us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217007.659846:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 31 00000100:00100000:2.0:1782217007.665094:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217007.665236:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714053376 00000100:00100000:3.0:1782217007.665246:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714053376 00000100:00100000:3.0:1782217007.665303:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 128 00000100:00100000:3.0:1782217007.665312:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a0e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+18:10536:x1868789714053376:12345-192.168.203.19@tcp:58:lfs.0 00000040:00080000:3.0:1782217007.665674:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1782217007.665759:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a0e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+18:10536:x1868789714053376:12345-192.168.203.19@tcp:58:lfs.0 Request processed in 447us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217007.665777:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 128 00000100:00100000:2.0:1782217007.668736:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217007.668833:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714053632 00000100:00100000:3.0:1782217007.668844:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714053632 00000100:00100000:3.0:1782217007.668936:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 32 00000100:00100000:3.0:1782217007.668946:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664ed0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+18:10537:x1868789714053632:12345-192.168.203.19@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1782217007.669745:0:5787:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1782217007.669844:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1782217007.670252:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f40f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217007.670268:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f40f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217007.670279:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f40f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217007.670289:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f40f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217007.670295:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f40f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217007.670301:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f40f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217007.670324:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782217007.670540:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782217007.670546:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f40f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.670553:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738af400 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:1.0:1782217007.670557:0:5772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f40f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.670565:0:5772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f40f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.670577:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88e65417fb00) 00010000:00010000:1.0:1782217007.670580:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782217007.670585:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f40f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.670590:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f40f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.670606:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217007.670608:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217007.670610:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782217007.671119:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664ed0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+20:10537:x1868789714053632:12345-192.168.203.19@tcp:35:lhsmtool_posix.0 Request processed in 2169us (2391us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1782217007.671129:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 32 00000020:00080000:2.0:1782217007.671135:0:5787:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1782217007.699671:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217007.699826:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714053760 00000100:00100000:1.0:1782217007.699837:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714053760 00000100:00100000:1.0:1782217007.699942:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 129 00000100:00100000:1.0:1782217007.699953:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a0e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+20:10539:x1868789714053760:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:1.0:1782217007.699978:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217007.699998:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f416 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620426 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.700099:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f41d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.700112:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f41d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.700123:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f41d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.700135:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f424 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.700142:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f424 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.700148:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f424 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.700444:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f42b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.700455:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f336 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203e7 expref: 21 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.700463:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f42b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.700495:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f336 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203e7 expref: 21 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217007.700519:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f336 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203e7 expref: 21 pid: 5784 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217007.700534:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e649194700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5784:1868789733986560:192.168.203.19@tcp:104: 00000100:00100000:1.0:1782217007.700616:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64e380900 going to sleep for 11 seconds 00010000:00010000:0.0:1782217007.701058:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217007.705069:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217007.705097:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714054016 00000100:00100000:0.0:1782217007.705105:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714054016 00000100:00100000:0.0:1782217007.705151:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 33 00000100:00100000:0.0:1782217007.705160:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+22:5569:x1868789714054016:12345-192.168.203.19@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1782217007.705401:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+23:5569:x1868789714054016:12345-192.168.203.19@tcp:35:ldlm_bl.0 Request processed in 240us (339us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1782217007.705408:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 33 00000100:00100000:1.0:1782217007.705724:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e649194700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5784:1868789733986560:192.168.203.19@tcp:104: 00010000:00010000:1.0:1782217007.705749:0:5784:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f42b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217007.708273:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217007.708515:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714054144 00000100:00100000:0.0:1782217007.708524:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714054144 00010000:00010000:0.0:1782217007.708560:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f336 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203e7 expref: 23 pid: 5784 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217007.708678:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 60 00000100:00100000:0.0:1782217007.708689:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652501180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+23:2359:x1868789714054144:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217007.708705:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217007.708723:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f336 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203e7 expref: 23 pid: 5784 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.708735:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f336 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203e7 expref: 23 pid: 5784 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.708758:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f336 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203e7 expref: 23 pid: 5784 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.708774:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88e67a811b00) 00010000:00010000:0.0:1782217007.708778:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f42b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.708787:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f42b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.708794:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f42b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217007.708826:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217007.708914:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652501180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+22:2359:x1868789714054144:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 227us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217007.708922:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 60 00010000:00010000:3.0:1782217007.709135:0:5784:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f42b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.709144:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f42b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217007.709185:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1782217007.709189:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782217007.709209:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f42b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.709222:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f42b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.709231:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f41d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.709238:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f41d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.709244:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f41d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.709249:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06c00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217007.709259:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f41d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.709266:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f41d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.709274:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88e650a64700) 00010000:00010000:3.0:1782217007.709276:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217007.709278:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f41d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.709282:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f41d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.709290:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f424 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.709293:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f424 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.709296:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f424 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.709300:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06600 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217007.709301:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f424 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.709304:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f424 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.709308:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88e67a811900) 00010000:00010000:3.0:1782217007.709309:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217007.709314:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f424 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.709318:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f424 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.709355:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f416 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620426 expref: 22 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.709381:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f42b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620426 expref: 21 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217007.709392:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88e67a811b00) 00010000:00010000:3.0:1782217007.709395:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782217007.709397:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd07600, rc 0) 00000100:00100000:3.0:1782217007.709428:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a0e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+21:10539:x1868789714053760:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 9478us (9780us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217007.709435:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 129 00000100:00100000:0.0:1782217008.089333:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733986688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782217008.089451:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217008.093252:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733986688 00000100:00100000:0.0:1782217008.093273:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733986688 00000100:00100000:0.0:1782217008.093376:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782217008.093388:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3302:x1868789733986688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782217008.093471:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 3407872 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782217008.093582:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3302:x1868789733986688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 196us (4130us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217008.093590:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782217008.100276:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733986688:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782217008.100512:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1782217008.167225:0:6609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:0.0:1782217008.167247:0:6609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:0.0:1782217008.167269:0:6609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000040:00080000:0.0:1782217008.512701:0:11903:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782217008.512716:0:11903:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782217008.512769:0:11903:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1782217008.512777:0:11903:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1782217008.661205:0:11532:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782217008.661220:0:11532:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782217008.661283:0:11532:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1782217008.661292:0:11532:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782217008.661534:0:11532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e649194700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11532:1868789733986816:192.168.203.19@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1782217008.661656:0:11532:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e67f2e5180 going to sleep for 11 seconds 00000100:00100000:1.0:1782217008.669618:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217008.669961:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714054272 00000100:00100000:3.0:1782217008.669973:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714054272 00000100:00100000:3.0:1782217008.670108:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 130 00000100:00100000:3.0:1782217008.670120:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+22:10551:x1868789714054272:12345-192.168.203.19@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1782217008.670166:0:5783:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00080000:1.0:1782217008.674485:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782217008.674750:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+22:10551:x1868789714054272:12345-192.168.203.19@tcp:53:lhsmtool_posix.0 Request processed in 4621us (5136us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217008.674766:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 130 00000100:00100000:3.0:1782217008.675223:0:11532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e649194700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11532:1868789733986816:192.168.203.19@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782217008.680612:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217008.681455:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714054528 00000100:00100000:1.0:1782217008.681470:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714054528 00000100:00100000:1.0:1782217008.681543:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 131 00000100:00100000:1.0:1782217008.681555:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67426dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+21:10551:x1868789714054528:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782217008.681581:0:6855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217008.681607:0:6855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f432 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62042d expref: -99 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217008.681750:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f439 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217008.681767:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f439 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217008.681784:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f439 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217008.681798:0:6855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1782217008.681977:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f432 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62042d expref: 24 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217008.681999:0:6855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f439 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62042d expref: 23 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217008.682009:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88e67a811b00) 00010000:00010000:1.0:1782217008.682013:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782217008.682018:0:6855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd06200, rc 0) 00000100:00100000:1.0:1782217008.682087:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67426dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+23:10551:x1868789714054528:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 535us (1490us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1782217008.682095:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 131 00000100:00100000:1.0:1782217008.689680:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217008.689746:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217008.689785:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714054912 00000100:00100000:1.0:1782217008.689804:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714054912 00000100:00100000:1.0:1782217008.689891:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 8 00000100:00100000:1.0:1782217008.689904:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e644798450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+23:2357:x1868789714054912:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782217008.689932:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217008.689965:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f439 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62042d expref: 23 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217008.689988:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88e67a811b00) 00010000:00010000:1.0:1782217008.689994:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782217008.690281:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e644798450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+22:2357:x1868789714054912:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 378us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217008.690290:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 8 00000100:00100000:3.0:1782217008.690559:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714054784 00000100:00100000:3.0:1782217008.690566:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714054784 00000100:00100000:3.0:1782217008.690604:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 132 00000100:00100000:3.0:1782217008.690613:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+22:10551:x1868789714054784:12345-192.168.203.19@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1782217008.692476:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f447 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217008.692507:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f447 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217008.692523:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f447 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217008.692778:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f447 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217008.692787:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f447 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217008.692795:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f447 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217008.692802:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e653161200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217008.692808:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f447 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217008.692817:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f447 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217008.692831:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88e67a811b00) 00010000:00010000:3.0:1782217008.692834:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782217008.692859:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f447 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217008.692867:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a9075089f447 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217008.693090:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+23:10551:x1868789714054784:12345-192.168.203.19@tcp:57:lhsmtool_posix.0 Request processed in 2472us (3417us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1782217008.693103:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 132 00000040:00080000:1.0:1782217008.694039:0:11532:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782217008.694048:0:11532:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782217008.694978:0:11532:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1782217008.694991:0:11532:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782217008.698733:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217008.698777:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714055168 00000100:00100000:2.0:1782217008.698789:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714055168 00000100:00100000:2.0:1782217008.698856:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 34 00000100:00100000:2.0:1782217008.698870:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+23:10551:x1868789714055168:12345-192.168.203.19@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1782217008.699200:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+24:10551:x1868789714055168:12345-192.168.203.19@tcp:35:lhsmtool_posix.0 Request processed in 332us (474us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1782217008.699210:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 34 00010000:00010000:1.0:1782217008.724470:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782217009.148242:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217009.148358:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217009.148688:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714055296 00000100:00100000:0.0:1782217009.148703:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714055296 00000100:00100000:1.0:1782217009.148736:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714055424 00000100:00100000:1.0:1782217009.148744:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714055424 00000100:00100000:0.0:1782217009.148782:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 287 00000100:00100000:0.0:1782217009.148795:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2356:x1868789714055296:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:1.0:1782217009.148801:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 133 00000100:00100000:1.0:1782217009.148814:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+24:2356:x1868789714055424:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:1.0:1782217009.148964:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+24:2356:x1868789714055424:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 153us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217009.148974:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 133 00000100:00100000:0.0:1782217009.148993:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2356:x1868789714055296:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 192us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217009.149001:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 287 00000100:00100000:2.0:1782217009.158476:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217009.158568:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217009.158734:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714055680 00000100:00100000:1.0:1782217009.158747:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714055680 00000100:00100000:1.0:1782217009.158848:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 76 00000100:00100000:1.0:1782217009.158862:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f18b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2356:x1868789714055680:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:1.0:1782217009.159053:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f18b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2356:x1868789714055680:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 194us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217009.159070:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 76 00000100:00080000:2.0:1782217009.159423:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782217009.159808:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714055808 00000100:00100000:3.0:1782217009.159817:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714055808 00000100:00100000:3.0:1782217009.159908:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 134 00000100:00100000:3.0:1782217009.160126:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649191f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2356:x1868789714055808:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:3.0:1782217009.160257:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649191f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2356:x1868789714055808:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 137us (1794us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217009.160265:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 134 00000100:00100000:0.0:1782217009.160445:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217009.160641:0:11864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714055552 00000100:00100000:3.0:1782217009.160648:0:11864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714055552 00000100:00100000:3.0:1782217009.160691:0:11864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 77 00000100:00100000:3.0:1782217009.160700:0:11864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2357:x1868789714055552:12345-192.168.203.19@tcp:400:kworker.0 00000100:00080000:1.0:1782217009.160710:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782217009.160717:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782217009.161435:0:11864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2357:x1868789714055552:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 595us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217009.161448:0:11864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 77 00010000:00010000:2.0:1782217009.748678:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782217010.132290:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868789733987072:0@lo:400:kworker.0 00000100:00100000:1.0:1782217010.132396:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217010.132484:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782217010.132486:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733987072 00000100:00100000:1.0:1782217010.132493:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733986944:0@lo:400:kworker.0 00000100:00100000:2.0:1782217010.132497:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733987072 00000100:00100000:1.0:1782217010.132530:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217010.132564:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1782217010.132575:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868789733987072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217010.132578:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733986944 00000100:00100000:1.0:1782217010.132584:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733986944 00000100:00100000:1.0:1782217010.132624:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1782217010.132633:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+19:3304:x1868789733986944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217010.132643:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868789733987072:12345-0@lo:400:kworker.0 Request processed in 70us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217010.132652:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1782217010.132673:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+19:3304:x1868789733986944:12345-0@lo:400:kworker.0 Request processed in 41us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217010.132681:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1782217010.132717:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733986944:0@lo:400:kworker.0 00000100:00100000:2.0:1782217010.132733:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868789733987072:0@lo:400:kworker.0 00000100:00100000:0.0:1782217010.133107:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67fff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1868789733987328:0@lo:400:kworker.0 00000100:00100000:2.0:1782217010.133116:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1868789733987456:0@lo:400:kworker.0 00000100:00100000:0.0:1782217010.133151:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217010.133159:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a1f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733987584:0@lo:400:kworker.0 00000100:00100000:0.0:1782217010.133189:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782217010.133193:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217010.133209:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f62c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733987200:0@lo:400:kworker.0 00000100:00100000:2.0:1782217010.133233:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733987584 00000100:00100000:2.0:1782217010.133238:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733987584 00000100:00100000:0.0:1782217010.133242:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217010.133298:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733987200 00000100:00100000:2.0:1782217010.133301:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733987200 00000100:00100000:2.0:1782217010.133350:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1782217010.133357:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1868789733987584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217010.133380:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1782217010.133397:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1868789733987584:12345-0@lo:400:kworker.0 Request processed in 39us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217010.133400:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733987200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217010.133408:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1782217010.133429:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782217010.133434:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782217010.133448:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217010.133457:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733987200:12345-0@lo:400:kworker.0 Request processed in 60us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217010.133465:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1782217010.133484:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733987328 00000100:00100000:2.0:1782217010.133488:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733987328 00000100:00100000:0.0:1782217010.133509:0:3302:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1782217010.133516:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000100:00100000:2.0:1782217010.133519:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733987456 00000100:00100000:2.0:1782217010.133523:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733987456 00000004:00080000:0.0:1782217010.133539:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88e64e2a3480, transno 4294967301 00000100:00100000:2.0:1782217010.133545:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1782217010.133552:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1868789733987328:12345-0@lo:400:kworker.0 00000004:00080000:0.0:1782217010.133555:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1782217010.133568:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88e67a0e3b80, transno 4294967304 00000100:00100000:0.0:1782217010.133576:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f62c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733987200:0@lo:400:kworker.0 00000100:00100000:2.0:1782217010.133588:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1868789733987328:12345-0@lo:400:kworker.0 Request processed in 36us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217010.133594:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67fff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1868789733987328:0@lo:400:kworker.0 00000100:00100000:2.0:1782217010.133600:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1782217010.133617:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1782217010.133624:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f188a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1868789733987456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217010.133662:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f188a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1868789733987456:12345-0@lo:400:kworker.0 Request processed in 38us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217010.133668:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1782217010.133714:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1868789733987456:0@lo:400:kworker.0 00000100:00080000:3.0:1782217010.134078:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782217010.134109:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a1f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733987584:0@lo:400:kworker.0 00000040:00080000:2.0:1782217010.347383:0:11955:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782217010.347396:0:11955:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782217010.347447:0:11955:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1782217010.347454:0:11955:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782217010.560766:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217010.560812:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714056064 00000100:00100000:0.0:1782217010.560823:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714056064 00000100:00100000:0.0:1782217010.560934:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 133 00000100:00100000:0.0:1782217010.560946:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+24:10572:x1868789714056064:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:0.0:1782217010.560974:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217010.561000:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a9075089f44e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620434 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217010.562390:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089f455 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217010.562415:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089f455 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217010.562453:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089f455 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217010.562469:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1782217010.562641:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a9075089f44e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620434 expref: 27 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217010.562662:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089f455 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620434 expref: 26 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217010.562673:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88e67a811b00) 00010000:00010000:0.0:1782217010.562677:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1782217010.562681:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437b000, rc 0) 00000100:00100000:0.0:1782217010.562766:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+26:10572:x1868789714056064:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 1822us (2011us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1782217010.562776:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 133 00000100:00080000:0.0:1782217010.562818:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782217010.573286:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217010.574974:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714056192 00000100:00100000:0.0:1782217010.574990:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714056192 00000100:00100000:0.0:1782217010.575130:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 134 00000100:00100000:0.0:1782217010.575143:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+26:10572:x1868789714056192:12345-192.168.203.19@tcp:54:lfs.0 00010000:00010000:0.0:1782217010.578227:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a9075089f463 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217010.578258:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a9075089f463 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217010.578273:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a9075089f463 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217010.578325:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a9075089f463 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217010.578333:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a9075089f463 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217010.578352:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a9075089f463 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217010.578359:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437b800 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217010.578364:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a9075089f463 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217010.578373:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a9075089f463 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217010.578387:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88e67a811b00) 00010000:00010000:0.0:1782217010.578391:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782217010.578397:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a9075089f463 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217010.578404:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a9075089f463 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217010.578508:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+26:10572:x1868789714056192:12345-192.168.203.19@tcp:54:lfs.0 Request processed in 3361us (5229us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217010.578520:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 134 00000100:00100000:3.0:1782217010.644399:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782217010.644444:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f62c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733987712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782217010.644692:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217010.644743:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733987712 00000100:00100000:0.0:1782217010.644755:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733987712 00000100:00100000:0.0:1782217010.644822:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782217010.644842:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1868789733987712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782217010.644923:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782217010.644976:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1868789733987712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217010.644985:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782217010.645062:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f62c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733987712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782217010.655300:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217010.655773:0:11864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714056320 00000100:00100000:3.0:1782217010.655787:0:11864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714056320 00000100:00100000:3.0:1782217010.655864:0:11864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 47 00000100:00100000:3.0:1782217010.655925:0:11864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f62ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2357:x1868789714056320:12345-192.168.203.19@tcp:101:cat.0 00010000:00010000:3.0:1782217010.655951:0:11864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217010.655977:0:11864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4c4199c/0xf210a9075089f46a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62043b expref: -99 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782217010.656015:0:11864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a3a792e, atime: 0x6a3a792d, ctime: 0x6a3a792e, blocks: 0xb 00010000:00010000:3.0:1782217010.656040:0:11864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=329s v=(0 0) 00010000:00010000:3.0:1782217010.656045:0:11864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217010.656068:0:11864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4c4199c/0xf210a9075089f46a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62043b expref: 7 pid: 11864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217010.656091:0:11864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a4c4199c/0xf210a9075089f46a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62043b expref: 7 pid: 11864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217010.656109:0:11864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e653161200, rc 0) 00000100:00100000:3.0:1782217010.656183:0:11864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f62ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:2357:x1868789714056320:12345-192.168.203.19@tcp:101:cat.0 Request processed in 309us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217010.657788:0:11864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 47 00000100:00100000:1.0:1782217010.662849:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217010.665825:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714056448 00000100:00100000:0.0:1782217010.665845:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714056448 00002000:00100000:0.0:1782217010.668169:0:6584:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff88e649197480 x1868789714056448/t0(0) o3->10ba4d21-74e8-42e8-8e52-48a327751cbd@192.168.203.19@tcp:261/0 lens 488/0 e 0 to 0 dl 1782217021 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782217010.668198:0:6584:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff88e649197480 with x1868789714056448 ext(0->4095) 00002000:00010000:0.0:1782217010.668209:0:6584:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88e649197480 00000100:00100000:0.0:1782217010.668391:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 3 00000100:00100000:0.0:1782217010.668417:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:2359:x1868789714056448:12345-192.168.203.19@tcp:3:cat.0 00000100:00100000:0.0:1782217010.668770:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:2359:x1868789714056448:12345-192.168.203.19@tcp:3:cat.0 Request processed in 366us (6144us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1782217010.668779:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 3 00002000:00100000:0.0:1782217010.668789:0:6584:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff88e649197480 x1868789714056448/t0(0) o3->10ba4d21-74e8-42e8-8e52-48a327751cbd@192.168.203.19@tcp:261/0 lens 488/4536 e 0 to 0 dl 1782217021 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782217010.668798:0:6584:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff88e649197480 with x1868789714056448 ext(0->4095) 00002000:00010000:0.0:1782217010.668802:0:6584:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88e649197480 00010000:00010000:1.0:1782217010.772117:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217011.796446:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782217012.773023:0:5805:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1782217012.773052:0:5805:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88e64e380240 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1782217012.773057:0:5805:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff88e67407c500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88e64e380d80 00000020:00080000:3.0:1782217012.773085:0:5805:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff88e67407c400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88e67f294c00 00000020:00080000:3.0:1782217012.773134:0:5805:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1782217012.773146:0:5817:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1782217012.777610:0:5817:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:3.0:1782217012.787143:0:7488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:3.0:1782217012.787158:0:7488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00010000:00010000:1.0:1782217012.820969:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782217013.211645:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f18aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733987840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782217013.211715:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217013.211768:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733987840 00000100:00100000:3.0:1782217013.211776:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733987840 00000100:00100000:3.0:1782217013.211845:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1782217013.211856:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733987840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782217013.211921:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782217013.211976:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733987840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217013.211983:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1782217013.212029:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f18aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733987840:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782217013.212155:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782217013.845374:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782217014.274438:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217014.274535:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217014.274754:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714056576 00000100:00100000:1.0:1782217014.274778:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714056576 00000100:00100000:1.0:1782217014.275202:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 289 00000100:00100000:1.0:1782217014.275223:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2359:x1868789714056576:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:1.0:1782217014.275329:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2359:x1868789714056576:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 109us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217014.275338:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 289 00000100:00100000:1.0:1782217014.276926:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217014.276955:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217014.276982:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217014.281787:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714056704 00000100:00100000:1.0:1782217014.281840:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714056960 00000100:00100000:1.0:1782217014.281848:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714056960 00000100:00100000:0.0:1782217014.281872:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714056704 00000100:00100000:1.0:1782217014.281940:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714056832 00000100:00100000:1.0:1782217014.281944:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714056832 00000100:00100000:1.0:1782217014.281976:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 80 00000100:00100000:1.0:1782217014.281986:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2358:x1868789714056960:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:1.0:1782217014.282080:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2358:x1868789714056960:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 95us (5164us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217014.282088:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 80 00000100:00100000:1.0:1782217014.282105:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 81 00000100:00100000:1.0:1782217014.282111:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2359:x1868789714056832:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:1.0:1782217014.282132:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2359:x1868789714056832:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 21us (5176us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217014.282137:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 81 00000100:00080000:1.0:1782217014.283512:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782217014.283522:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782217014.283525:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782217014.288440:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714057088 00000100:00100000:0.0:1782217014.288459:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714057088 00000100:00100000:3.0:1782217014.288463:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 138 00000100:00100000:3.0:1782217014.288482:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+13:2358:x1868789714056704:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:0.0:1782217014.288529:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 139 00000100:00100000:0.0:1782217014.288536:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2359:x1868789714057088:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:3.0:1782217014.289964:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+13:2358:x1868789714056704:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 1477us (15528us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217014.289981:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 138 00000100:00100000:0.0:1782217014.291061:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2359:x1868789714057088:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 2517us (14069us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217014.291076:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 139 00000100:00080000:0.0:1782217014.291115:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782217014.869373:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782217014.932814:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217014.933027:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714057216 00000100:00100000:3.0:1782217014.933040:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714057216 00000100:00100000:3.0:1782217014.933120:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 135 00000100:00100000:3.0:1782217014.933133:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+13:10225:x1868789714057216:12345-192.168.203.19@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1782217014.933364:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+13:10225:x1868789714057216:12345-192.168.203.19@tcp:60:lhsmtool_posix.0 Request processed in 221us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217014.933397:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 135 00000100:00100000:3.0:1782217014.936548:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217014.936718:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714057472 00000100:00100000:2.0:1782217014.936728:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714057472 00000100:00100000:2.0:1782217014.936790:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 35 00000100:00100000:2.0:1782217014.936800:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+13:10225:x1868789714057472:12345-192.168.203.19@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1782217014.940780:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+14:10225:x1868789714057472:12345-192.168.203.19@tcp:35:lhsmtool_posix.0 Request processed in 3968us (4229us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1782217014.940795:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 35 00000100:00100000:1.0:1782217015.184511:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217015.184624:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714057600 00000100:00100000:0.0:1782217015.184634:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714057600 00000100:00100000:0.0:1782217015.184696:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 136 00000100:00100000:0.0:1782217015.184707:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:11026:x1868789714057600:12345-192.168.203.19@tcp:101:lsof.0 00010000:00010000:0.0:1782217015.184729:0:6855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217015.184748:0:6855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f471 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620442 expref: -99 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217015.184824:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f478 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217015.184837:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f478 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217015.184850:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f478 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217015.185090:0:6855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782217015.185094:0:6855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1782217015.185193:0:6855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f478 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217015.185218:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f471 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620442 expref: 7 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217015.185244:0:6855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f478 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620442 expref: 6 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217015.185251:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e65417f500) 00010000:00010000:0.0:1782217015.185254:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782217015.185258:0:6855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437a800, rc 0) 00000100:00100000:0.0:1782217015.185330:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+6:11026:x1868789714057600:12345-192.168.203.19@tcp:101:lsof.0 Request processed in 625us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217015.185337:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 136 00000100:00100000:2.0:1782217015.255029:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f62c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789733987968:0@lo:400:kworker.0 00000100:00100000:2.0:1782217015.255108:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217015.255157:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6508db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1868789733988480:0@lo:400:kworker.0 00000100:00100000:2.0:1782217015.255184:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217015.255211:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1782217015.255216:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6508db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733988224:0@lo:400:kworker.0 00000100:00100000:2.0:1782217015.255217:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6508db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868789733988096:0@lo:400:kworker.0 00000100:00100000:2.0:1782217015.255237:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217015.255244:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217015.255254:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6508d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733988608:0@lo:400:kworker.0 00000100:00100000:1.0:1782217015.255260:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782217015.255265:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6508dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1868789733988352:0@lo:400:kworker.0 00000100:00100000:2.0:1782217015.255273:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217015.255281:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217015.255300:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733988480 00000100:00100000:1.0:1782217015.255312:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733987968 00000100:00100000:2.0:1782217015.255317:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733988480 00000100:00100000:1.0:1782217015.255317:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733987968 00000100:00100000:2.0:1782217015.255353:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733988096 00000100:00100000:2.0:1782217015.255355:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733988096 00000100:00100000:1.0:1782217015.255356:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1782217015.255363:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+19:3303:x1868789733987968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217015.255365:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733988352 00000100:00100000:2.0:1782217015.255366:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733988352 00000100:00100000:2.0:1782217015.255379:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1782217015.255384:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f189500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1868789733988480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217015.255472:0:11864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733988224 00000100:00100000:3.0:1782217015.255477:0:11864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733988224 00000100:00100000:3.0:1782217015.255507:0:11864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733988608 00000100:00100000:3.0:1782217015.255510:0:11864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733988608 00000100:00100000:3.0:1782217015.255529:0:11864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1782217015.255535:0:11864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733988224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217015.255575:0:11864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733988224:12345-0@lo:400:kworker.0 Request processed in 39us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217015.255581:0:11864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1782217015.255597:0:11864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1782217015.255603:0:11864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f18a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733988608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217015.255644:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f189500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1868789733988480:12345-0@lo:400:kworker.0 Request processed in 259us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217015.255661:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1782217015.255675:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1782217015.255680:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f189180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868789733988096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217015.255746:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1782217015.255756:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1868789733988352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217015.255791:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1868789733988352:12345-0@lo:400:kworker.0 Request processed in 38us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217015.255796:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1782217015.255870:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6508dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1868789733988352:0@lo:400:kworker.0 00000100:00100000:0.0:1782217015.255911:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6508db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733988224:0@lo:400:kworker.0 00000100:00080000:0.0:1782217015.255934:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782217015.255937:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782217015.255940:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782217015.259172:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+19:3303:x1868789733987968:12345-0@lo:400:kworker.0 Request processed in 3800us (4054us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217015.259187:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1782217015.270565:0:11864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f18a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733988608:12345-0@lo:400:kworker.0 Request processed in 14951us (15279us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217015.270580:0:11864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1782217015.270718:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f189180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868789733988096:12345-0@lo:400:kworker.0 Request processed in 15036us (15477us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217015.270728:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1782217015.273136:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6508db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868789733988096:0@lo:400:kworker.0 00000100:00100000:3.0:1782217015.273156:0:3303:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1782217015.273162:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1782217015.273189:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6508d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733988608:0@lo:400:kworker.0 00000100:00100000:3.0:1782217015.273210:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6508db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1868789733988480:0@lo:400:kworker.0 00000100:00100000:3.0:1782217015.273221:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f62c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789733987968:0@lo:400:kworker.0 00000100:00100000:1.0:1782217015.764248:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6508db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733988736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782217015.764332:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217015.764456:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733988736 00000100:00100000:0.0:1782217015.764464:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733988736 00000100:00100000:0.0:1782217015.764519:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1782217015.764529:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733988736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782217015.764563:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782217015.764621:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733988736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217015.764628:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1782217015.764833:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6508db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733988736:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782217015.897678:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217016.919356:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782217017.879166:0:5805:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1782217017.879192:0:5805:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1782217017.879243:0:5817:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1782217017.879262:0:5817:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1782217017.944126:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782217017.947152:0:11532:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782217017.947165:0:11532:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782217017.947541:0:11532:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1782217017.947550:0:11532:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782217018.327503:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f18a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733988864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782217018.327604:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217018.327760:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733988864 00000100:00100000:2.0:1782217018.327770:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733988864 00000100:00100000:2.0:1782217018.327846:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1782217018.327857:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733988864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782217018.327920:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782217018.327975:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733988864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217018.327983:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1782217018.328042:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782217018.328091:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f18a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733988864:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1782217018.596721:0:12155:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 08:16:56 (1782217016) 00010000:00010000:1.0:1782217018.964484:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217019.394067:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217019.394186:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217019.394222:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217019.394314:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217019.394545:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714057984 00000100:00100000:1.0:1782217019.394557:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714057984 00000100:00100000:1.0:1782217019.394642:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 84 00000100:00100000:1.0:1782217019.394653:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f62c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2358:x1868789714057984:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:1.0:1782217019.394762:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f62c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2358:x1868789714057984:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 110us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217019.394771:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 84 00000100:00080000:1.0:1782217019.394800:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782217019.395757:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714057728 00000100:00100000:2.0:1782217019.396269:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714057728 00000100:00100000:2.0:1782217019.396348:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 291 00000100:00100000:2.0:1782217019.396359:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2358:x1868789714057728:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:2.0:1782217019.396453:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2358:x1868789714057728:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 95us (2401us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217019.396462:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 291 00000100:00100000:3.0:1782217019.397463:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217019.397941:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714058112 00000100:00100000:2.0:1782217019.397952:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714058112 00000100:00100000:2.0:1782217019.398038:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 85 00000100:00100000:2.0:1782217019.398049:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f758700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2358:x1868789714058112:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:2.0:1782217019.398152:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f758700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2358:x1868789714058112:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 105us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217019.398161:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 85 00000100:00100000:0.0:1782217019.398317:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714058240 00000100:00100000:0.0:1782217019.398324:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714058240 00000100:00100000:0.0:1782217019.398421:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714057856 00000100:00100000:0.0:1782217019.398426:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714057856 00000100:00100000:2.0:1782217019.398475:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 143 00000100:00100000:2.0:1782217019.398485:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f75b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+6:2358:x1868789714058240:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:2.0:1782217019.398528:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f75b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+6:2358:x1868789714058240:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 45us (4305us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217019.398536:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 143 00000100:00100000:2.0:1782217019.398556:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 144 00000100:00100000:2.0:1782217019.398564:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f75bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+13:2358:x1868789714057856:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:2.0:1782217019.398615:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f75bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+13:2358:x1868789714057856:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 51us (4300us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217019.398623:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 144 00000100:00080000:3.0:1782217019.398656:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782217019.398663:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782217019.893928:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217019.894748:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714058496 00000100:00100000:2.0:1782217019.894764:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714058496 00000100:00100000:2.0:1782217019.894848:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 137 00000100:00100000:2.0:1782217019.894861:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f758000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+13:11291:x1868789714058496:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782217019.894968:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217019.894996:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aea00/0xf210a9075089f47f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620449 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217019.895093:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089f486 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217019.895110:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089f486 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217019.895141:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089f486 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217019.895159:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f48d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217019.895167:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f48d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217019.895178:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f48d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217019.896252:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089f494 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217019.896285:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089f494 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217019.896296:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089f494 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217019.896308:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1782217019.896657:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089f486 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217019.896666:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089f486 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217019.896674:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089f486 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217019.896680:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738af600 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217019.896691:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089f486 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217019.896700:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089f486 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217019.896715:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88e650a64b00) 00010000:00010000:2.0:1782217019.896718:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217019.896723:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089f486 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217019.896731:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089f486 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217019.896744:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f48d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217019.896750:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f48d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217019.896757:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f48d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217019.896763:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738ae800 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217019.896765:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f48d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217019.896771:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f48d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217019.896777:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff88e65417f600) 00010000:00010000:2.0:1782217019.896779:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217019.896786:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f48d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217019.896793:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f48d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217019.897617:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aea00/0xf210a9075089f47f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620449 expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217019.897640:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089f494 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620449 expref: 15 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217019.897649:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88e67a811700) 00010000:00010000:2.0:1782217019.897652:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217019.897654:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738afa00, rc 0) 00000100:00100000:2.0:1782217019.897752:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f758000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+15:11291:x1868789714058496:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 2893us (3873us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1782217019.897762:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 137 00000100:00100000:2.0:1782217019.906795:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217019.906848:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217019.907077:0:8301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714058752 00000100:00100000:3.0:1782217019.907093:0:8301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714058752 00000100:00100000:0.0:1782217019.907132:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714058624 00000100:00100000:0.0:1782217019.907138:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714058624 00000100:00100000:0.0:1782217019.907201:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 138 00000100:00100000:0.0:1782217019.907213:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f188e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+16:11291:x1868789714058624:12345-192.168.203.19@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1782217019.907299:0:8301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 9 00000100:00100000:3.0:1782217019.907308:0:8301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f18bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:10ba4d21-74e8-42e8-8e52-48a327751cbd+16:2359:x1868789714058752:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217019.907322:0:8301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217019.907353:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089f494 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620449 expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217019.907367:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f188e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+16:11291:x1868789714058624:12345-192.168.203.19@tcp:59:lhsmtool_posix.0 Request processed in 154us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217019.907377:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 138 00010000:00010000:3.0:1782217019.907380:0:8301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88e67a811700) 00010000:00010000:3.0:1782217019.907387:0:8301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217019.907413:0:8301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f18bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:10ba4d21-74e8-42e8-8e52-48a327751cbd+14:2359:x1868789714058752:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 107us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217019.907420:0:8301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 9 00000040:00080000:3.0:1782217019.988164:0:11532:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782217019.988187:0:11532:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782217019.988235:0:11532:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1782217019.988244:0:11532:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1782217019.988600:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217020.376144:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f759f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789733988992:0@lo:400:kworker.0 00000100:00100000:3.0:1782217020.376238:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217020.376304:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6454aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1868789733989504:0@lo:400:kworker.0 00000100:00100000:3.0:1782217020.376337:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217020.377104:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782217020.377112:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f759500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868789733989120:0@lo:400:kworker.0 00000100:00100000:3.0:1782217020.377140:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217020.377163:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e646105c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733989632:0@lo:400:kworker.0 00000100:00100000:3.0:1782217020.377188:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217020.377203:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733989504 00000100:00100000:1.0:1782217020.377214:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733989504 00000100:00100000:3.0:1782217020.377218:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733989248:0@lo:400:kworker.0 00000100:00100000:3.0:1782217020.377243:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217020.377262:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782217020.377278:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6454aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1868789733989376:0@lo:400:kworker.0 00000100:00100000:3.0:1782217020.377303:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217020.377336:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733988992 00000100:00100000:3.0:1782217020.377340:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733988992 00000100:00100000:3.0:1782217020.378380:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1782217020.378394:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+19:3303:x1868789733988992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217020.378575:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733989120 00000100:00100000:1.0:1782217020.378582:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733989120 00000100:00100000:1.0:1782217020.378606:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733989376 00000100:00100000:1.0:1782217020.378608:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733989376 00000100:00100000:3.0:1782217020.378822:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+19:3303:x1868789733988992:12345-0@lo:400:kworker.0 Request processed in 430us (2582us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217020.378831:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1782217020.378909:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1782217020.378965:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1782217020.378987:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e646104000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1868789733989504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217020.379037:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e646104000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1868789733989504:12345-0@lo:400:kworker.0 Request processed in 121us (2700us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217020.379044:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1782217020.379060:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1782217020.379066:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1868789733989376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217020.379113:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1868789733989376:12345-0@lo:400:kworker.0 Request processed in 47us (1810us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217020.379119:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1782217020.379139:0:11864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733989632 00000100:00100000:3.0:1782217020.379143:0:11864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733989632 00000100:00100000:3.0:1782217020.379172:0:11864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733989248 00000100:00100000:3.0:1782217020.379176:0:11864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733989248 00000100:00100000:3.0:1782217020.379197:0:11864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1782217020.379203:0:11864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e646105180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733989632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217020.379237:0:11864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e646105180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733989632:12345-0@lo:400:kworker.0 Request processed in 34us (2048us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217020.379253:0:11864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1782217020.379279:0:11864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1782217020.379286:0:11864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e646105f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733989248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217020.379314:0:11864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e646105f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733989248:12345-0@lo:400:kworker.0 Request processed in 30us (2070us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217020.379320:0:11864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1782217020.379345:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782217020.379350:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782217020.379353:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782217020.379425:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e646105c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733989632:0@lo:400:kworker.0 00000100:00100000:3.0:1782217020.379450:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f759f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789733988992:0@lo:400:kworker.0 00000100:00100000:3.0:1782217020.379463:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6454aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1868789733989504:0@lo:400:kworker.0 00000100:00100000:0.0:1782217020.380163:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6454aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1868789733989376:0@lo:400:kworker.0 00000100:00100000:0.0:1782217020.380180:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733989248:0@lo:400:kworker.0 00000100:00100000:1.0:1782217020.381349:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e646107480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868789733989120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217020.381628:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e646107480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868789733989120:12345-0@lo:400:kworker.0 Request processed in 2655us (4484us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217020.381640:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1782217020.382578:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f759500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868789733989120:0@lo:400:kworker.0 00000100:00100000:3.0:1782217020.884122:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6508dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733989760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782217020.884190:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217020.884303:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733989760 00000100:00100000:2.0:1782217020.884311:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733989760 00000100:00100000:2.0:1782217020.884362:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1782217020.884370:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a805c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733989760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782217020.884402:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782217020.889477:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a805c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733989760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5098us (5277us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217020.889491:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1782217020.890380:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6508dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733989760:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782217021.020757:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217021.890265:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217021.890386:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714058880 00000100:00100000:1.0:1782217021.890401:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714058880 00000100:00100000:1.0:1782217021.890497:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 139 00000100:00100000:1.0:1782217021.890511:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+14:11334:x1868789714058880:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:1.0:1782217021.890540:0:6855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217021.890564:0:6855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f4a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620450 expref: -99 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217021.890645:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f4a9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217021.890671:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f4a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217021.890699:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f4a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217021.890715:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f4b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217021.890723:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f4b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217021.890729:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f4b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1782217021.891070:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782217021.891208:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f4a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217021.891218:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f4a9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217021.891226:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f4a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217021.891306:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217021.891313:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f4a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217021.891322:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f4a9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217021.891336:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e65417f500) 00010000:00010000:1.0:1782217021.891340:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217021.891346:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f4a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217021.891360:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f4a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217021.891373:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f4b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217021.891380:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f4b0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217021.891386:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f4b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217021.891392:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217021.891395:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f4b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217021.891402:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f4b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217021.891409:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff88e67a811c00) 00010000:00010000:1.0:1782217021.891412:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217021.891415:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f4b0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217021.891421:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f4b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217021.891463:0:6855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f4a2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620450 expref: 15 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217021.891489:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e65417f500) 00010000:00010000:1.0:1782217021.891492:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217021.891497:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f4a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620450 expref: 15 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217021.891507:0:6855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd07e00, rc 0) 00000100:00100000:1.0:1782217021.891593:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+14:11334:x1868789714058880:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 1087us (1360us total) trans 0 rc 301/301 00000100:00100000:1.0:1782217021.891602:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 139 00000100:00100000:0.0:1782217021.897425:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217021.897957:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714059136 00000100:00100000:3.0:1782217021.897970:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714059136 00000100:00100000:3.0:1782217021.898036:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 140 00000100:00100000:3.0:1782217021.898047:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+14:11334:x1868789714059136:12345-192.168.203.19@tcp:36:lfs.0 00010000:00010000:3.0:1782217021.898116:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217021.898149:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aee00/0xf210a9075089ee20 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620289 expref: 14 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217021.898171:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e65417f500) 00010000:00010000:3.0:1782217021.898177:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782217021.898527:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f4b7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217021.898545:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f478 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620442 expref: 5 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217021.898555:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f4b7 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217021.898617:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f478 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620442 expref: 5 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217021.898633:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f478 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620442 expref: 5 pid: 6855 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217021.898651:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a806a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5784:1868789733989888:192.168.203.19@tcp:104: 00000100:00100000:3.0:1782217021.898760:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6413e4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782217021.904202:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217021.904272:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714059264 00000100:00100000:2.0:1782217021.904284:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714059264 00010000:00010000:2.0:1782217021.904394:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f478 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620442 expref: 6 pid: 6855 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1782217021.904619:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782217021.904696:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 61 00000100:00100000:2.0:1782217021.904707:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6454aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+6:2359:x1868789714059264:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217021.904727:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217021.904735:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f478 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620442 expref: 6 pid: 6855 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217021.904751:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f478 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620442 expref: 6 pid: 6855 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217021.904779:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e65417f500) 00010000:00010000:2.0:1782217021.904786:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f4b7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217021.904798:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f4b7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217021.904806:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f4b7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217021.904861:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217021.904986:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6454aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+6:2359:x1868789714059264:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 260us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217021.904994:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 61 00010000:00010000:0.0:1782217021.906236:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f478 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620442 expref: 5 pid: 6855 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217021.906491:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a806a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5784:1868789733989888:192.168.203.19@tcp:104: 00010000:00010000:0.0:1782217021.906516:0:5784:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f4b7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217021.906534:0:5784:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f4b7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217021.906539:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f4b7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217021.906564:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f4be lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217021.906574:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f4be lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217021.906581:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f4be lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217021.913866:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1782217021.913958:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f4b7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217021.913978:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f4b7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217021.913987:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f4b7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217021.913994:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e653161c00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217021.914001:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f4b7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217021.914016:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f4b7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217021.914061:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e65417f500) 00010000:00010000:0.0:1782217021.914064:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217021.914070:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f4b7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217021.914081:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f4b7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782217021.914109:0:5784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006e03b845 reply state 000000004a16397b transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f4be lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217021.914119:0:5784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782217021.914265:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+15:11334:x1868789714059136:12345-192.168.203.19@tcp:36:lfs.0 Request processed in 16206us (16844us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1782217021.914275:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 140 00010000:00010000:3.0:1782217021.920592:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f4be lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217021.920611:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f4be lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217021.920620:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f4be lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217021.920627:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437ae00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217021.920633:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f4be lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217021.920642:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f4be lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217021.920662:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff88e647d05c00) 00010000:00010000:3.0:1782217021.920665:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217021.920680:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f4be lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217021.920688:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f4be lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217022.000869:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217022.001291:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714059392 00000100:00100000:3.0:1782217022.001313:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714059392 00000100:00100000:3.0:1782217022.001395:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 141 00000100:00100000:3.0:1782217022.001407:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f188700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+14:11342:x1868789714059392:12345-192.168.203.19@tcp:101:lctl.0 00010000:00010000:3.0:1782217022.001449:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217022.001478:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f4c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620457 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.001562:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a9075089f4cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.001579:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a9075089f4cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.001594:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a9075089f4cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217022.001673:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782217022.001678:0:5783:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1782217022.001721:0:5783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a9075089f4cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.001750:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f4c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620457 expref: 16 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.001784:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a9075089f4cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620457 expref: 15 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.001812:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e650a64300) 00010000:00010000:3.0:1782217022.001816:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782217022.001820:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e653161600, rc 0) 00000100:00100000:3.0:1782217022.001942:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f188700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+15:11342:x1868789714059392:12345-192.168.203.19@tcp:101:lctl.0 Request processed in 537us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217022.001952:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 141 00010000:00010000:2.0:1782217022.036121:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217022.056736:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217022.056849:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714059520 00000100:00100000:1.0:1782217022.056861:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714059520 00000100:00100000:1.0:1782217022.056999:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 142 00000100:00100000:1.0:1782217022.057012:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+15:11348:x1868789714059520:12345-192.168.203.19@tcp:101:bash.0 00010000:00010000:1.0:1782217022.057067:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217022.057119:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f4d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62045e expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.057274:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f4da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.057291:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f4da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.057315:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f4da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.057343:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f4e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.057381:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f4e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.057404:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f4e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.060777:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f4e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.060801:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f4e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.060814:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f4e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217022.060971:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1782217022.060975:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782217022.061003:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f4e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.061018:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f4da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.061024:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f4da lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.061030:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f4da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.061037:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217022.061041:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f4da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.061063:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f4da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.061076:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e650a64300) 00010000:00010000:1.0:1782217022.061079:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217022.061084:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f4da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.061089:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f4da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.061105:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f4e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.061111:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f4e1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.061117:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f4e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.061122:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217022.061125:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f4e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.061130:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f4e1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.061137:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff88e67a811c00) 00010000:00010000:1.0:1782217022.061139:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217022.061142:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f4e1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.061157:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f4e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.061198:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f4d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62045e expref: 17 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.061212:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f4e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62045e expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.061220:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88e67a811000) 00010000:00010000:1.0:1782217022.061222:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782217022.061225:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd06600, rc 0) 00000100:00100000:1.0:1782217022.062681:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+16:11348:x1868789714059520:12345-192.168.203.19@tcp:101:bash.0 Request processed in 5663us (5951us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217022.062693:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 142 00000100:00100000:2.0:1782217022.073386:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217022.073578:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714059776 00000100:00100000:1.0:1782217022.073588:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714059776 00000100:00100000:1.0:1782217022.073652:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 143 00000100:00100000:1.0:1782217022.073662:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f189880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+16:11348:x1868789714059776:12345-192.168.203.19@tcp:101:bash.0 00010000:00010000:1.0:1782217022.073683:0:6855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217022.073704:0:6855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f4ef lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620465 expref: -99 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.073851:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f4f6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.073865:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f4f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.073933:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f4f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.073949:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f4fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.073957:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f4fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.073964:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f4fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782217022.074507:0:6855:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1782217022.074670:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f504 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.074681:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f504 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.074688:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f504 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.074724:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f4f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.074731:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f4f6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.074737:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f4f6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.074744:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217022.074755:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f4f6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.074763:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f4f6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.074775:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88e67a811000) 00010000:00010000:1.0:1782217022.074777:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217022.074781:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f4f6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.074788:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f4f6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782217022.074800:0:6855:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000630a3582 reply state 0000000089144f07 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f4fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217022.074809:0:6855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782217022.074839:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f4ef lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620465 expref: 19 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.074852:0:6855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f504 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620465 expref: 18 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.074858:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e67a811400) 00010000:00010000:1.0:1782217022.074860:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782217022.074862:0:6855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd06c00, rc 0) 00000100:00100000:1.0:1782217022.075229:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f189880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+19:11348:x1868789714059776:12345-192.168.203.19@tcp:101:bash.0 Request processed in 1567us (1851us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1782217022.075238:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 143 00010000:00010000:0.0:1782217022.085177:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f4fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217022.085194:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f4fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217022.085202:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f4fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217022.085209:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217022.085214:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f4fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217022.085221:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f4fd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217022.085265:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88e67a811c00) 00010000:00010000:0.0:1782217022.085269:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217022.085274:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f4fd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217022.085281:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f4fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217022.086931:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217022.086996:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714059904 00000100:00100000:0.0:1782217022.087009:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714059904 00000100:00100000:0.0:1782217022.087096:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 48 00000100:00100000:0.0:1782217022.087107:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f189c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2358:x1868789714059904:12345-192.168.203.19@tcp:101:bash.0 00010000:00010000:0.0:1782217022.087125:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217022.087144:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f612072d/0xf210a9075089f512 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62046c expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782217022.087171:0:6579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782217022.087190:0:6579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=341s v=(0 0) 00010000:00010000:0.0:1782217022.087195:0:6579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217022.087203:0:6579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f612072d/0xf210a9075089f512 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62046c expref: 6 pid: 6579 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217022.087220:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f612072d/0xf210a9075089f512 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62046c expref: 6 pid: 6579 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217022.087232:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437a800, rc 0) 00000100:00100000:0.0:1782217022.087312:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f189c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2358:x1868789714059904:12345-192.168.203.19@tcp:101:bash.0 Request processed in 207us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217022.087329:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 48 00000100:00080000:3.0:1782217022.090066:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782217022.097069:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217022.097178:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714060032 00000100:00100000:3.0:1782217022.097188:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714060032 00000100:00100000:3.0:1782217022.097304:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 49 00000100:00100000:3.0:1782217022.097325:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f188000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:11348:x1868789714060032:12345-192.168.203.19@tcp:101:bash.0 00010000:00010000:3.0:1782217022.097343:0:7991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217022.097362:0:7991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e593ba5e/0xf210a9075089f519 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620473 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.097396:0:7991:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f612072d/0xf210a9075089f512 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62046c expref: 7 pid: 6579 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.097406:0:7991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217022.097410:0:7991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217022.097416:0:7991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e593ba5e/0xf210a9075089f519 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620473 expref: 7 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.097454:0:7991:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f612072d/0xf210a9075089f512 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62046c expref: 7 pid: 6579 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.097489:0:7991:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f612072d/0xf210a9075089f512 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62046c expref: 7 pid: 6579 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217022.097505:0:7991:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6454aa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7991:1868789733990016:192.168.203.19@tcp:104: 00000100:00100000:3.0:1782217022.097654:0:7991:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6413e4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782217022.100867:0:7991:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6454aa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7991:1868789733990016:192.168.203.19@tcp:104: 00010000:00010000:3.0:1782217022.100936:0:7991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e593ba5e/0xf210a9075089f519 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620473 expref: 7 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.100958:0:7991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e653160e00, rc 0) 00000100:00100000:3.0:1782217022.101011:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f188000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:11348:x1868789714060032:12345-192.168.203.19@tcp:101:bash.0 Request processed in 3698us (3952us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217022.101021:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 49 00000100:00100000:0.0:1782217022.101329:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217022.101487:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714060160 00000100:00100000:1.0:1782217022.101497:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714060160 00010000:00010000:1.0:1782217022.101527:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f612072d/0xf210a9075089f512 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62046c expref: 7 pid: 6579 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217022.101563:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 62 00000100:00100000:1.0:1782217022.101572:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:2359:x1868789714060160:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782217022.101583:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217022.101603:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f612072d/0xf210a9075089f512 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62046c expref: 7 pid: 6579 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.101616:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f612072d/0xf210a9075089f512 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62046c expref: 7 pid: 6579 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.101640:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f612072d/0xf210a9075089f512 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62046c expref: 7 pid: 6579 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.101654:0:5768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217022.101658:0:5768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217022.101666:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e593ba5e/0xf210a9075089f519 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620473 expref: 6 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.101678:0:5768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e593ba5e/0xf210a9075089f519 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620473 expref: 6 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.101711:0:5768:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e593ba5e/0xf210a9075089f519 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620473 expref: 6 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217022.101732:0:5768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a0e3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5768:1868789733990144:192.168.203.19@tcp:105: 00000100:00100000:1.0:1782217022.101791:0:5768:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6447dfa80 going to sleep for 11 seconds 00000100:00100000:1.0:1782217022.105625:0:5768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a0e3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5768:1868789733990144:192.168.203.19@tcp:105: 00010000:00010000:1.0:1782217022.105655:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782217022.105728:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2359:x1868789714060160:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 4156us (4398us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217022.105742:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 62 00000100:00100000:2.0:1782217022.105840:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217022.106015:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714060416 00000100:00100000:0.0:1782217022.106026:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714060416 00000100:00100000:0.0:1782217022.106087:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 36 00000100:00100000:0.0:1782217022.106100:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f18b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+18:11348:x1868789714060416:12345-192.168.203.19@tcp:35:bash.0 00000100:00100000:0.0:1782217022.107850:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f18b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+19:11348:x1868789714060416:12345-192.168.203.19@tcp:35:bash.0 Request processed in 1675us (1938us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1782217022.107865:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 36 00000100:00100000:2.0:1782217022.185615:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217022.185738:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714060672 00000100:00100000:0.0:1782217022.185751:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714060672 00000100:00100000:0.0:1782217022.185834:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 144 00000100:00100000:0.0:1782217022.185861:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f18b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+19:11358:x1868789714060672:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:0.0:1782217022.185936:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217022.185964:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f520 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62047a expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217022.186534:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1782217022.186704:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f520 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62047a expref: 21 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217022.186722:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e650a64300) 00010000:00010000:0.0:1782217022.186725:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782217022.186732:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f520 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62047a expref: 21 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217022.186771:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437bc00, rc 0) 00000100:00100000:0.0:1782217022.187046:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f18b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+20:11358:x1868789714060672:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 1187us (1444us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1782217022.187056:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 144 00000100:00100000:2.0:1782217022.193008:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217022.193143:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714060928 00000100:00100000:1.0:1782217022.193168:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714060928 00000100:00100000:1.0:1782217022.193249:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 37 00000100:00100000:1.0:1782217022.193269:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f18ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+20:11358:x1868789714060928:12345-192.168.203.19@tcp:35:lfs.0 00000100:00100000:1.0:1782217022.194347:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f18ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+21:11358:x1868789714060928:12345-192.168.203.19@tcp:35:lfs.0 Request processed in 1075us (1347us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1782217022.194360:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 37 00000100:00100000:3.0:1782217022.311798:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217022.311919:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714061056 00000100:00100000:2.0:1782217022.311928:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714061056 00000100:00100000:2.0:1782217022.312035:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 145 00000100:00100000:2.0:1782217022.312053:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6454aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+21:11364:x1868789714061056:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:2.0:1782217022.312075:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217022.312095:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f52e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620481 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.312160:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089f535 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.312173:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089f535 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.312184:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089f535 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217022.312243:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1782217022.312247:0:5783:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1782217022.312292:0:5783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089f535 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.312320:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f52e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620481 expref: 23 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.312354:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089f535 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620481 expref: 22 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.312363:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88e67a811000) 00010000:00010000:2.0:1782217022.312366:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782217022.312369:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738ae200, rc 0) 00000100:00100000:2.0:1782217022.312429:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6454aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+22:11364:x1868789714061056:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 384us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217022.312436:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 145 00000100:00100000:2.0:1782217022.320171:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217022.320243:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714061312 00000100:00100000:1.0:1782217022.320260:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714061312 00000100:00100000:1.0:1782217022.320682:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 146 00000100:00100000:1.0:1782217022.320693:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f18a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+22:11364:x1868789714061312:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:1.0:1782217022.320711:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217022.320730:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f53c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620488 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.320841:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f543 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.320872:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f543 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.320914:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f543 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217022.320927:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1782217022.321060:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f53c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620488 expref: 25 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.321079:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f543 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620488 expref: 24 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.321087:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e67a811400) 00010000:00010000:1.0:1782217022.321090:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782217022.321093:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd06200, rc 0) 00000100:00100000:1.0:1782217022.321153:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f18a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+24:11364:x1868789714061312:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 463us (990us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1782217022.321160:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 146 00000100:00100000:2.0:1782217022.327564:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217022.340426:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217022.340787:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714061568 00000100:00100000:0.0:1782217022.340798:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714061568 00000100:00100000:0.0:1782217022.340857:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 147 00000100:00100000:0.0:1782217022.340868:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f18aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+24:11364:x1868789714061568:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:0.0:1782217022.340908:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217022.340928:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f551 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62048f expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217022.341032:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f558 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217022.341047:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f558 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217022.341059:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f558 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217022.341072:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00000100:00100000:3.0:1782217022.341379:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714061696 00000100:00100000:3.0:1782217022.341385:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714061696 00000100:00100000:3.0:1782217022.341420:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 10 00000100:00100000:3.0:1782217022.341428:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+27:2359:x1868789714061696:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217022.341437:0:8299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217022.341453:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f543 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620488 expref: 27 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.341470:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e67a811400) 00010000:00010000:3.0:1782217022.341486:0:8299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217022.341549:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+26:2359:x1868789714061696:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 121us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217022.341557:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 10 00010000:00010000:0.0:1782217022.341691:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f551 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62048f expref: 26 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217022.341709:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f558 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62048f expref: 25 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217022.341730:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e67a811400) 00010000:00010000:0.0:1782217022.341733:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1782217022.341736:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437aa00, rc 0) 00000100:00100000:0.0:1782217022.341775:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f18aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+25:11364:x1868789714061568:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 909us (14220us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1782217022.341783:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 147 00000100:00100000:0.0:1782217022.349402:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217022.349474:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714061824 00000100:00100000:3.0:1782217022.349490:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714061824 00000100:00100000:3.0:1782217022.349585:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 50 00000100:00100000:3.0:1782217022.349602:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2358:x1868789714061824:12345-192.168.203.19@tcp:1:lfs.0 00010000:00010000:3.0:1782217022.349663:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6e0616f/0xf210a9075089f566 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.349689:0:6580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e593ba5e/0xf210a9075089f519 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620473 expref: 6 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.349699:0:6580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217022.349704:0:6580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782217022.349709:0:6580:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6e0616f/0xf210a9075089f566 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.349854:0:6580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e593ba5e/0xf210a9075089f519 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620473 expref: 6 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.349871:0:6580:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e593ba5e/0xf210a9075089f519 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620473 expref: 6 pid: 7991 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217022.349973:0:6580:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f759500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6580:1868789733990272:192.168.203.19@tcp:104: 00000100:00100000:3.0:1782217022.350107:0:6580:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6413e4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782217022.353446:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217022.353527:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714061952 00000100:00100000:1.0:1782217022.353542:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714061952 00002000:00100000:1.0:1782217022.353599:0:6583:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff88e67f759f80 x1868789714061952/t0(0) o4->10ba4d21-74e8-42e8-8e52-48a327751cbd@192.168.203.19@tcp:273/0 lens 504/0 e 0 to 0 dl 1782217033 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782217022.353611:0:6583:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff88e67f759f80 with x1868789714061952 ext(0->12) 00010000:00010000:1.0:1782217022.353621:0:6583:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e593ba5e/0xf210a9075089f519 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620473 expref: 7 pid: 7991 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.353656:0:6583:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e593ba5e/0xf210a9075089f519 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620473 expref: 7 pid: 7991 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782217022.353665:0:6583:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88e67f759f80 00000100:00100000:1.0:1782217022.353703:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 2 00000100:00100000:1.0:1782217022.353713:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f759f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:2358:x1868789714061952:12345-192.168.203.19@tcp:4:lfs.0 00000100:00100000:2.0:1782217022.353842:0:6580:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f759500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6580:1868789733990272:192.168.203.19@tcp:104: 00010000:00010000:2.0:1782217022.353990:0:6580:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e6e0616f/0xf210a9075089f566 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217022.354281:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f759f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+9:2358:x1868789714061952:12345-192.168.203.19@tcp:4:lfs.0 Request processed in 566us (847us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1782217022.354291:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 2 00002000:00100000:1.0:1782217022.354298:0:6583:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff88e67f759f80 x1868789714061952/t4294967305(0) o4->10ba4d21-74e8-42e8-8e52-48a327751cbd@192.168.203.19@tcp:273/0 lens 504/448 e 0 to 0 dl 1782217033 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782217022.354307:0:6583:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff88e67f759f80 with x1868789714061952 ext(0->12) 00010000:00010000:1.0:1782217022.354314:0:6583:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e593ba5e/0xf210a9075089f519 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620473 expref: 9 pid: 7991 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.354329:0:6583:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e593ba5e/0xf210a9075089f519 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620473 expref: 9 pid: 7991 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782217022.354336:0:6583:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88e67f759f80 00000100:00100000:0.0:1782217022.357529:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217022.358227:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714062080 00000100:00100000:2.0:1782217022.358247:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714062080 00010000:00010000:2.0:1782217022.358318:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e593ba5e/0xf210a9075089f519 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620473 expref: 9 pid: 7991 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217022.358371:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 63 00000100:00100000:2.0:1782217022.358384:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+9:2357:x1868789714062080:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217022.358415:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1782217022.358456:0:5769:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1782217022.358459:0:5769:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1782217021 00002000:00010000:2.0:1782217022.358462:0:5769:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1782217021 00002000:00010000:2.0:1782217022.358464:0:5769:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1782217021 00010000:00010000:2.0:1782217022.358471:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e593ba5e/0xf210a9075089f519 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620473 expref: 9 pid: 7991 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.358486:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e593ba5e/0xf210a9075089f519 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620473 expref: 9 pid: 7991 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.358513:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e593ba5e/0xf210a9075089f519 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620473 expref: 9 pid: 7991 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.358537:0:5769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782217022.358542:0:5769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782217022.358548:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e6e0616f/0xf210a9075089f566 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.358559:0:5769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6e0616f/0xf210a9075089f566 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.358597:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782217022.358671:0:6580:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e6e0616f/0xf210a9075089f566 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217022.358687:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+8:2357:x1868789714062080:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 304us (1165us total) trans 0 rc 0/0 00010000:00010000:3.0:1782217022.358715:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6e0616f/0xf210a9075089f566 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217022.358717:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 63 00010000:00010000:3.0:1782217022.358770:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6e0616f/0xf210a9075089f566 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.358781:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6e0616f/0xf210a9075089f566 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.358790:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6e0616f/0xf210a9075089f566 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.358797:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640030200 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217022.358801:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6e0616f/0xf210a9075089f566 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.358810:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6e0616f/0xf210a9075089f566 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.358830:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6e0616f/0xf210a9075089f566 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.358838:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6e0616f/0xf210a9075089f566 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217022.358987:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:2358:x1868789714061824:12345-192.168.203.19@tcp:1:lfs.0 Request processed in 9389us (9591us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217022.358996:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 50 00000100:00100000:0.0:1782217022.364589:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217022.367172:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714062336 00000100:00100000:2.0:1782217022.367193:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714062336 00000100:00100000:2.0:1782217022.367296:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 38 00000100:00100000:2.0:1782217022.367334:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664e8f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+25:11364:x1868789714062336:12345-192.168.203.19@tcp:35:lfs.0 00000004:00010000:2.0:1782217022.367440:0:5787:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f558 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62048f expref: 25 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782217022.367857:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1782217022.368108:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1782217022.368921:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:3.0:1782217022.369000:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089f56d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.369022:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f504 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620465 expref: 29 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.369031:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089f56d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.369074:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f504 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620465 expref: 29 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.369093:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f504 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620465 expref: 29 pid: 6855 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217022.369111:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f759500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5787:1868789733990400:192.168.203.19@tcp:104: 00000100:00100000:3.0:1782217022.369210:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6413e4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782217022.372942:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f759500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5787:1868789733990400:192.168.203.19@tcp:104: 00010000:00010000:3.0:1782217022.372977:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089f56d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217022.375473:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217022.376279:0:8300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714062464 00000100:00100000:2.0:1782217022.376297:0:8300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714062464 00010000:00010000:2.0:1782217022.376362:0:8300:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f504 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620465 expref: 30 pid: 6855 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217022.376425:0:8300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 64 00000100:00100000:2.0:1782217022.376437:0:8300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+30:2359:x1868789714062464:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217022.376456:0:8300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217022.376463:0:8300:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f504 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620465 expref: 30 pid: 6855 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.376478:0:8300:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f504 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620465 expref: 30 pid: 6855 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.376506:0:8300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f504 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620465 expref: 30 pid: 6855 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.376529:0:8300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e67a811400) 00010000:00010000:2.0:1782217022.376535:0:8300:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089f56d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.376545:0:8300:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089f56d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.376572:0:8300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089f56d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.376607:0:8300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217022.376793:0:8300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+29:2359:x1868789714062464:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 357us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217022.376802:0:8300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 64 00010000:00010000:3.0:1782217022.379061:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089f56d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.379159:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089f56d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782217022.381224:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1782217022.385057:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:3.0:1782217022.385420:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f759500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5787:1868789733990528:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1782217022.385489:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217022.385531:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64902ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782217022.385901:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733990528 00000100:00100000:0.0:1782217022.386215:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733990528 00000100:00100000:0.0:1782217022.386300:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782217022.386312:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e646105c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5787:x1868789733990528:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1782217022.386421:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e646105c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5787:x1868789733990528:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 112us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217022.386429:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782217022.386540:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f759500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5787:1868789733990528:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:3.0:1782217022.386543:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1782217022.387444:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1782217022.387551:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f759500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5787:1868789733990656:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1782217022.387628:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217022.387670:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6413e4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782217022.388247:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733990656 00000100:00100000:3.0:1782217022.388268:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733990656 00000100:00100000:3.0:1782217022.388317:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782217022.388337:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5787:x1868789733990656:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1782217022.388619:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5787:x1868789733990656:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 282us (990us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1782217022.388628:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782217022.390678:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f759500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5787:1868789733990656:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1782217022.390822:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1782217022.390951:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089f56d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.390964:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089f56d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.390973:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089f56d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.390981:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640030200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217022.390986:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089f56d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.390995:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089f56d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.391032:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e67a811400) 00010000:00010000:2.0:1782217022.391035:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1782217022.391041:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089f56d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.391047:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089f56d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782217022.391311:0:5787:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1782217022.391439:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1782217022.391451:0:5787:0:(osp_sync.c:1862:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 341443573340ns, next at 342443571193ns, rc = 0 00000001:00080000:2.0:1782217022.391459:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1782217022.391493:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e67a811400) 00010000:00010000:2.0:1782217022.391496:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1782217022.391504:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f558 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62048f expref: 33 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217022.391652:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664e8f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+32:11364:x1868789714062336:12345-192.168.203.19@tcp:35:lfs.0 Request processed in 24323us (27072us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1782217022.391665:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 38 00000020:00080000:2.0:1782217022.391673:0:5787:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1782217022.395386:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217022.395470:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714062592 00000100:00100000:3.0:1782217022.395480:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714062592 00000100:00100000:3.0:1782217022.395580:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 148 00000100:00100000:3.0:1782217022.395591:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+32:11364:x1868789714062592:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:3.0:1782217022.395616:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217022.395642:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089f574 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620496 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.395705:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089f574 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620496 expref: 33 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.395735:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089f574 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620496 expref: 33 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.395756:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e650a64500) 00010000:00010000:3.0:1782217022.395760:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782217022.395763:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e640031600, rc 0) 00000100:00100000:3.0:1782217022.395830:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+33:11364:x1868789714062592:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 241us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217022.395838:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 148 00000100:00100000:0.0:1782217022.403664:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217022.403747:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714062848 00000100:00100000:1.0:1782217022.403757:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714062848 00000100:00100000:1.0:1782217022.403862:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 39 00000100:00100000:1.0:1782217022.403890:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+33:11364:x1868789714062848:12345-192.168.203.19@tcp:35:lfs.0 00000100:00100000:1.0:1782217022.404159:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+34:11364:x1868789714062848:12345-192.168.203.19@tcp:35:lfs.0 Request processed in 286us (504us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1782217022.404168:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 39 00000100:00100000:1.0:1782217022.498848:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217022.498976:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714063104 00000100:00100000:2.0:1782217022.498990:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714063104 00000100:00100000:2.0:1782217022.499066:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 149 00000100:00100000:2.0:1782217022.499077:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a0e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+34:11374:x1868789714063104:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:2.0:1782217022.499101:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217022.499122:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f57b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62049d expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217022.499274:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1782217022.499404:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f57b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62049d expref: 36 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.499418:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e650a64300) 00010000:00010000:2.0:1782217022.499422:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782217022.499427:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f57b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62049d expref: 36 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.499443:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738af400, rc 0) 00000100:00100000:2.0:1782217022.499503:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a0e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+35:11374:x1868789714063104:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 428us (669us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1782217022.499511:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 149 00000100:00100000:0.0:1782217022.511392:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217022.512062:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714063232 00000100:00100000:3.0:1782217022.512081:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714063232 00000100:00100000:3.0:1782217022.512352:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 150 00000100:00100000:3.0:1782217022.512366:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+35:11374:x1868789714063232:12345-192.168.203.19@tcp:34:lfs.0 00010000:00010000:3.0:1782217022.512481:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089f589 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.512506:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089f589 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.512520:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089f589 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.512536:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f590 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.512543:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f590 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.512572:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f590 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.512717:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089f597 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.512725:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089f597 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.512733:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089f597 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782217022.517413:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089f597 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.517448:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089f589 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.517456:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089f589 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.517464:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089f589 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.517470:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640031e00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217022.517475:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089f589 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.517483:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089f589 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.517507:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88e67a811000) 00010000:00010000:3.0:1782217022.517536:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217022.517543:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089f589 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.517550:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089f589 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.517575:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f590 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.517581:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f590 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.517587:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f590 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.517592:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640030600 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217022.517595:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f590 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.517600:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f590 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.517608:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88e650a64200) 00010000:00010000:3.0:1782217022.517611:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217022.517629:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f590 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.517637:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f590 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.517657:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089f597 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.517670:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089f597 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.517676:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089f597 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.517681:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640030200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217022.517683:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089f597 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.517689:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089f597 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.517697:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e650a64500) 00010000:00010000:3.0:1782217022.517700:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217022.517703:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089f597 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.517709:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089f597 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217022.519198:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+35:11374:x1868789714063232:12345-192.168.203.19@tcp:34:lfs.0 Request processed in 6821us (7875us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217022.519214:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 150 00000100:00100000:2.0:1782217022.527329:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217022.527404:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714063488 00000100:00100000:3.0:1782217022.527423:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714063488 00000100:00100000:3.0:1782217022.527509:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 40 00000100:00100000:3.0:1782217022.527521:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+35:11374:x1868789714063488:12345-192.168.203.19@tcp:35:lfs.0 00000100:00100000:3.0:1782217022.527864:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+36:11374:x1868789714063488:12345-192.168.203.19@tcp:35:lfs.0 Request processed in 344us (548us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1782217022.527934:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 40 00000100:00100000:1.0:1782217022.591559:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217022.591694:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714063744 00000100:00100000:2.0:1782217022.591707:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714063744 00000100:00100000:2.0:1782217022.591988:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 151 00000100:00100000:2.0:1782217022.592000:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a0e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+36:11377:x1868789714063744:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:2.0:1782217022.592030:0:6855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217022.592054:0:6855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f59e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6204a4 expref: -99 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.592146:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f5a5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.592162:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f5a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.592191:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f5a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.592206:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089f5ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.592213:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089f5ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.592219:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089f5ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.592378:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aea00/0xf210a9075089f5b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.592386:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aea00/0xf210a9075089f5b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.592393:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aea00/0xf210a9075089f5b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217022.592404:0:6855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1782217022.592516:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f5a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.592525:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f5a5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.592533:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f5a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.592539:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738af200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217022.592549:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f5a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.592558:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f5a5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.592572:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88e67a811000) 00010000:00010000:2.0:1782217022.592575:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217022.592579:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f5a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.592586:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f5a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.592601:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089f5ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.592607:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089f5ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.595050:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089f5ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.595817:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738afa00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217022.595831:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089f5ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.595845:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089f5ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.595867:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88e65417fb00) 00010000:00010000:2.0:1782217022.595871:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217022.595927:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089f5ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.595934:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089f5ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.596034:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f59e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204a4 expref: 39 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.596050:0:6855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aea00/0xf210a9075089f5b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204a4 expref: 38 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.596056:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e650a64500) 00010000:00010000:2.0:1782217022.596059:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782217022.596061:0:6855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738aea00, rc 0) 00000100:00100000:2.0:1782217022.596217:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a0e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+38:11377:x1868789714063744:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 4218us (4670us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1782217022.596229:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 151 00000100:00100000:0.0:1782217022.609062:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217022.609174:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714063872 00000100:00100000:2.0:1782217022.609188:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714063872 00000100:00100000:2.0:1782217022.609271:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 152 00000100:00100000:2.0:1782217022.609283:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+38:11377:x1868789714063872:12345-192.168.203.19@tcp:54:lfs.0 00010000:00010000:2.0:1782217022.609370:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f5c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.609389:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f5c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.609402:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f5c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.609452:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f5c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.609459:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f5c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.609467:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f5c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.609473:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738af400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217022.609477:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f5c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.609484:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f5c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.609496:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e650a64500) 00010000:00010000:2.0:1782217022.609500:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782217022.609505:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f5c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.609512:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f5c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217022.609606:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+38:11377:x1868789714063872:12345-192.168.203.19@tcp:54:lfs.0 Request processed in 324us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217022.609614:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 152 00000100:00100000:0.0:1782217022.618442:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217022.618546:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714064128 00000100:00100000:3.0:1782217022.618558:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714064128 00000100:00100000:3.0:1782217022.618627:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 41 00000100:00100000:3.0:1782217022.618639:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+38:11377:x1868789714064128:12345-192.168.203.19@tcp:35:lfs.0 00000100:00100000:3.0:1782217022.619100:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+39:11377:x1868789714064128:12345-192.168.203.19@tcp:35:lfs.0 Request processed in 460us (670us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1782217022.619109:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 41 00000100:00100000:1.0:1782217022.849560:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217022.850009:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714064384 00000100:00100000:2.0:1782217022.850023:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714064384 00000100:00100000:2.0:1782217022.850104:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 153 00000100:00100000:2.0:1782217022.850135:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a0e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+39:11408:x1868789714064384:12345-192.168.203.19@tcp:101:cat.0 00010000:00010000:2.0:1782217022.850169:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217022.850197:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f5c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6204ab expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.850403:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089f5cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.850420:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089f5cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.850434:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089f5cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217022.850447:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1782217022.850614:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f5c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204ab expref: 42 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.850643:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089f5cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204ab expref: 41 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.850653:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e650a64500) 00010000:00010000:2.0:1782217022.850656:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782217022.850659:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738afa00, rc 0) 00000100:00100000:2.0:1782217022.850761:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a0e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+41:11408:x1868789714064384:12345-192.168.203.19@tcp:101:cat.0 Request processed in 628us (1218us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1782217022.850769:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 153 00000100:00100000:0.0:1782217022.856078:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217022.856138:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217022.856299:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714064640 00000100:00100000:1.0:1782217022.856313:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714064640 00000100:00100000:3.0:1782217022.856448:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714064768 00000100:00100000:3.0:1782217022.856452:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714064768 00000100:00100000:3.0:1782217022.856514:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 11 00000100:00100000:3.0:1782217022.856526:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64479bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+42:2357:x1868789714064768:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217022.856547:0:8299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217022.856579:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089f5cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204ab expref: 42 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.856601:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e650a64500) 00010000:00010000:3.0:1782217022.856607:0:8299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217022.856681:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64479bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+41:2357:x1868789714064768:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 156us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217022.856690:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 11 00000100:00100000:1.0:1782217022.856997:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 42 00000100:00100000:1.0:1782217022.857008:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+40:11408:x1868789714064640:12345-192.168.203.19@tcp:35:cat.0 00000100:00100000:1.0:1782217022.857338:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+41:11408:x1868789714064640:12345-192.168.203.19@tcp:35:cat.0 Request processed in 331us (1273us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1782217022.857346:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 42 00000100:00100000:0.0:1782217022.911196:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217022.911315:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714065024 00000100:00100000:2.0:1782217022.911328:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714065024 00000100:00100000:2.0:1782217022.911473:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 154 00000100:00100000:2.0:1782217022.911495:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+41:11414:x1868789714065024:12345-192.168.203.19@tcp:101:dd.0 00010000:00010000:2.0:1782217022.911526:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217022.911530:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1782217022.911565:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089f535 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620481 expref: 41 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.911588:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88e67a811000) 00010000:00010000:2.0:1782217022.911594:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782217022.911612:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f5dd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6204b2 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.911737:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f5e4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.911753:0:5783:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aea00/0xf210a9075089f5b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204a4 expref: 41 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.911763:0:5783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f5e4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.912329:0:5783:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aea00/0xf210a9075089f5b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204a4 expref: 41 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.912345:0:5783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aea00/0xf210a9075089f5b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204a4 expref: 41 pid: 6855 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217022.912362:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664484380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5783:1868789733990784:192.168.203.19@tcp:104: 00000100:00100000:2.0:1782217022.912517:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6460469c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782217022.923001:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664484380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5783:1868789733990784:192.168.203.19@tcp:104: 00010000:00010000:2.0:1782217022.923039:0:5783:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f5e4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217022.923521:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217022.923965:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714065152 00000100:00100000:3.0:1782217022.923976:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714065152 00010000:00010000:3.0:1782217022.924027:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aea00/0xf210a9075089f5b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204a4 expref: 42 pid: 6855 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217022.924099:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 65 00000100:00100000:3.0:1782217022.924112:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+42:2358:x1868789714065152:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217022.924132:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217022.924140:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aea00/0xf210a9075089f5b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204a4 expref: 42 pid: 6855 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.924153:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aea00/0xf210a9075089f5b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204a4 expref: 42 pid: 6855 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.924377:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aea00/0xf210a9075089f5b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204a4 expref: 42 pid: 6855 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.924397:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e650a64500) 00010000:00010000:3.0:1782217022.924404:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f5e4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.924475:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f5e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.924484:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f5e4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.926108:0:5783:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f5e4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.926127:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f5e4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217022.926365:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1782217022.926500:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217022.926606:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+41:2358:x1868789714065152:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 2490us (3081us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217022.926617:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 65 00010000:00010000:2.0:1782217022.926940:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f5dd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204b2 expref: 42 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.926964:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f5e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204b2 expref: 41 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.926974:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e650a64500) 00010000:00010000:2.0:1782217022.926977:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782217022.926981:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738af200, rc 0) 00000100:00100000:2.0:1782217022.927011:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+41:11414:x1868789714065024:12345-192.168.203.19@tcp:101:dd.0 Request processed in 15520us (15832us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1782217022.927018:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 154 00000100:00100000:0.0:1782217022.933836:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217022.934638:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714065408 00000100:00100000:3.0:1782217022.934667:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714065408 00000100:00100000:3.0:1782217022.934762:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 155 00000100:00100000:3.0:1782217022.934776:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+41:11414:x1868789714065408:12345-192.168.203.19@tcp:36:dd.0 00010000:00010000:3.0:1782217022.935242:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f5f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.935275:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f5f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217022.935289:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f5f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782217022.935347:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1782217022.935374:0:5785:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e0604810 reply state 000000001a528ef7 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f5f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217022.935384:0:5785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782217022.939969:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+44:11414:x1868789714065408:12345-192.168.203.19@tcp:36:dd.0 Request processed in 5180us (6131us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1782217022.939985:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 155 00000020:00080000:3.0:1782217022.939993:0:5785:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1782217022.960456:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f5f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.960478:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f5f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.960488:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f5f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.960495:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640030600 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217022.960501:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f5f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.960510:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f5f2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.960553:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e650a64500) 00010000:00010000:1.0:1782217022.960557:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217022.960564:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f5f2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.960570:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f5f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782217022.990201:0:5805:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967422 is committed 00000001:00080000:3.0:1782217022.990235:0:5805:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967438 is committed 00000001:00080000:3.0:1782217022.990265:0:5805:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967439 is committed 00000004:00080000:3.0:1782217022.990280:0:5805:0:(osp_sync.c:1827:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1782217022.990311:0:5805:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88e65081f900 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1782217022.990318:0:5805:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff88e67fb4ba00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88e65081f3c0 00000020:00080000:3.0:1782217022.990322:0:5805:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff88e67fb4be00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88e680535000 00000020:00080000:0.0:1782217022.990470:0:5817:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1782217022.990705:0:5817:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1782217022.991062:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733990912:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782217022.991156:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217022.991385:0:11864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733990912 00000100:00100000:1.0:1782217022.991394:0:11864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733990912 00000100:00100000:1.0:1782217022.991559:0:11864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1782217022.991571:0:11864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3302:x1868789733990912:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782217022.991605:0:11864:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:1.0:1782217022.991646:0:11864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a3a793d, atime: 0x6a3a793d, ctime: 0x6a3a793d, blocks: 0x1 00010000:00010000:1.0:1782217022.991656:0:11864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069c90b12/0xf210a9075089f5f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.991677:0:11864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=342s v=(0 0) 00010000:00010000:1.0:1782217022.991681:0:11864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217022.991689:0:11864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069c90b12/0xf210a9075089f5f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.991707:0:11864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069c90b12/0xf210a9075089f5f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.991719:0:11864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069c90b12/0xf210a9075089f5f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.991759:0:11864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069c90b12/0xf210a9075089f5f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217022.991785:0:11864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782217022.992685:0:11864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3302:x1868789733990912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1111us (1524us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1782217022.992697:0:11864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:2.0:1782217022.992782:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782217022.992792:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069c90b12/0xf210a9075089f5f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.992816:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06200 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:2.0:1782217022.992821:0:5772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069c90b12/0xf210a9075089f5f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.992833:0:5772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069c90b12/0xf210a9075089f5f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.992855:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069c90b12/0xf210a9075089f5f9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.992862:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069c90b12/0xf210a9075089f5f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217022.992910:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217022.992912:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217022.992914:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1782217022.993130:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88e664484380/2, rc 0, transno 4294967307 00000100:00100000:0.0:1782217022.993138:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733990912:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782217023.060263:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217023.138797:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217023.139496:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714065536 00000100:00100000:3.0:1782217023.139529:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714065536 00000100:00100000:3.0:1782217023.140177:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 156 00000100:00100000:3.0:1782217023.140194:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+18:11428:x1868789714065536:12345-192.168.203.19@tcp:101:stat.0 00010000:00010000:3.0:1782217023.140236:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217023.140272:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089f600 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6204b9 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.140369:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089f607 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.140386:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089f607 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.140399:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089f607 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.140417:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f60e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.140425:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f60e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.140431:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f60e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.142115:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f615 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.142145:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f5e4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204b2 expref: 19 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.142156:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f615 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.142217:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f5e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204b2 expref: 19 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.142235:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f5e4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204b2 expref: 19 pid: 5783 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217023.142266:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6454aaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5784:1868789733991040:192.168.203.19@tcp:104: 00000100:00100000:3.0:1782217023.142399:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64902e180 going to sleep for 11 seconds 00000100:00100000:3.0:1782217023.147980:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00080000:0.0:1782217023.148274:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782217023.149672:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714065792 00000100:00100000:2.0:1782217023.149689:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714065792 00000100:00100000:2.0:1782217023.149784:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 43 00000100:00100000:2.0:1782217023.149797:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+20:5570:x1868789714065792:12345-192.168.203.19@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1782217023.150272:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+21:5570:x1868789714065792:12345-192.168.203.19@tcp:35:ldlm_bl.0 Request processed in 475us (2304us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1782217023.150283:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 43 00000100:00100000:1.0:1782217023.150296:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6454aaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5784:1868789733991040:192.168.203.19@tcp:104: 00010000:00010000:1.0:1782217023.150331:0:5784:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f615 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217023.155442:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217023.158659:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714065920 00000100:00100000:3.0:1782217023.158682:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714065920 00010000:00010000:3.0:1782217023.158752:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f5e4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204b2 expref: 21 pid: 5783 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217023.158898:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 66 00000100:00100000:3.0:1782217023.158911:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a0e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+21:2359:x1868789714065920:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217023.158933:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217023.158943:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f5e4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204b2 expref: 21 pid: 5783 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.158961:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f5e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204b2 expref: 21 pid: 5783 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.158991:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f5e4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204b2 expref: 21 pid: 5783 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.159036:0:5768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e650a64500) 00010000:00010000:3.0:1782217023.159042:0:5768:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f615 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.159053:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f615 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.159063:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f615 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.159103:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217023.159197:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a0e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+20:2359:x1868789714065920:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 287us (3770us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217023.159206:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 66 00010000:00010000:1.0:1782217023.159296:0:5784:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f615 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.159306:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f615 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217023.159367:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1782217023.159372:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782217023.159400:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f615 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.159414:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f615 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.159426:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089f607 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.159449:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089f607 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.159457:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089f607 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.159464:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640031e00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217023.159469:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089f607 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.159478:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089f607 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.159501:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88e67a811000) 00010000:00010000:1.0:1782217023.159504:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217023.159509:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089f607 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.159514:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031e00/0xf210a9075089f607 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.159527:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f60e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.159533:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f60e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.159539:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f60e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.159544:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640030600 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217023.159552:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f60e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.159559:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f60e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.159567:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88e660936000) 00010000:00010000:1.0:1782217023.159570:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217023.159573:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f60e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.159578:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030600/0xf210a9075089f60e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.159622:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030200/0xf210a9075089f600 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204b9 expref: 20 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.159637:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f615 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204b9 expref: 19 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.159645:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e650a64500) 00010000:00010000:1.0:1782217023.159648:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782217023.159650:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e653160e00, rc 0) 00000100:00100000:1.0:1782217023.159681:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+19:11428:x1868789714065536:12345-192.168.203.19@tcp:101:stat.0 Request processed in 19493us (20900us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217023.159688:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 156 00000100:00100000:3.0:1782217023.233838:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217023.234325:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714066176 00000100:00100000:0.0:1782217023.234339:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714066176 00000100:00100000:0.0:1782217023.234419:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 157 00000100:00100000:0.0:1782217023.234441:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a803100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+19:11434:x1868789714066176:12345-192.168.203.19@tcp:36:truncate.0 00010000:00010000:0.0:1782217023.234525:0:6855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217023.234562:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f615 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204b9 expref: 19 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217023.234587:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e650a64500) 00010000:00010000:0.0:1782217023.234594:0:6855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782217023.235170:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f61c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.235191:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f61c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.235223:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f61c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782217023.235305:0:6855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1782217023.235338:0:6855:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007608e97f reply state 00000000eac09e9c transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f61c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217023.235348:0:6855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782217023.235498:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a803100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+21:11434:x1868789714066176:12345-192.168.203.19@tcp:36:truncate.0 Request processed in 1065us (1673us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1782217023.235510:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 157 00000020:00080000:1.0:1782217023.235759:0:6855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1782217023.239700:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f61c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.239747:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f61c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.239756:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f61c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.239763:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217023.239769:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f61c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.239779:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f61c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.239802:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e650a64500) 00010000:00010000:2.0:1782217023.239805:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217023.239811:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f61c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.239817:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f61c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217023.381829:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217023.382013:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714066304 00000100:00100000:2.0:1782217023.382026:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714066304 00000100:00100000:2.0:1782217023.382330:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 158 00000100:00100000:2.0:1782217023.382343:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a801180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+20:11448:x1868789714066304:12345-192.168.203.19@tcp:101:stat.0 00010000:00010000:2.0:1782217023.382376:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217023.382404:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f623 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6204c0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.382490:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089f62a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.382523:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089f62a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.382536:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089f62a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.382553:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f631 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.382560:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f631 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.382566:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f631 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.383032:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089f638 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.383043:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089f638 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.383050:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089f638 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217023.383099:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1782217023.383104:0:5783:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782217023.383134:0:5783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089f638 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.383146:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089f638 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.383162:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089f62a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.383167:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089f62a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.383172:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089f62a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.383176:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738ae200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217023.383179:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089f62a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.383185:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089f62a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.383195:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88e67a811000) 00010000:00010000:2.0:1782217023.383197:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217023.383201:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089f62a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.383204:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089f62a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.383215:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f631 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.383414:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f631 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.383420:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f631 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.383433:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738ae800 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217023.383436:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f631 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.383443:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f631 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.383452:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88e65417fc00) 00010000:00010000:2.0:1782217023.383454:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217023.383456:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f631 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.383462:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f631 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.383501:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f623 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204c0 expref: 22 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.383516:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089f638 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204c0 expref: 21 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.383523:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e650a64500) 00010000:00010000:2.0:1782217023.383526:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782217023.383528:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738af600, rc 0) 00000100:00100000:2.0:1782217023.383684:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a801180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+21:11448:x1868789714066304:12345-192.168.203.19@tcp:101:stat.0 Request processed in 1342us (1869us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217023.383694:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 158 00000100:00100000:2.0:1782217023.446260:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733991168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782217023.446378:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217023.447057:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733991168 00000100:00100000:1.0:1782217023.448576:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733991168 00000100:00100000:1.0:1782217023.448662:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1782217023.448674:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1868789733991168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782217023.448716:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782217023.449972:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1868789733991168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1281us (3576us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217023.449987:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1782217023.452987:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733991168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782217023.470679:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217023.471200:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714066560 00000100:00100000:0.0:1782217023.471215:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714066560 00000100:00100000:0.0:1782217023.471304:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 159 00000100:00100000:0.0:1782217023.471333:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+21:11458:x1868789714066560:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:0.0:1782217023.471362:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217023.471410:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f63f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6204c7 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217023.471658:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1782217023.472572:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f63f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204c7 expref: 23 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217023.472593:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e650a64300) 00010000:00010000:0.0:1782217023.472597:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782217023.472604:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f63f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204c7 expref: 23 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217023.472621:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437a000, rc 0) 00000100:00100000:0.0:1782217023.473087:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+22:11458:x1868789714066560:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 1768us (2418us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1782217023.473098:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 159 00000100:00100000:0.0:1782217023.481289:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217023.481366:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714066816 00000100:00100000:0.0:1782217023.481379:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714066816 00000100:00100000:0.0:1782217023.481442:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 44 00000100:00100000:0.0:1782217023.481455:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664e8d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+22:11458:x1868789714066816:12345-192.168.203.19@tcp:35:lfs.0 00000100:00100000:0.0:1782217023.482592:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664e8d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+23:11458:x1868789714066816:12345-192.168.203.19@tcp:35:lfs.0 Request processed in 1131us (1721us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1782217023.482605:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 44 00000001:00080000:2.0:1782217023.525024:0:6609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:2.0:1782217023.525054:0:6609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:1.0:1782217023.565281:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217023.567305:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714067072 00000100:00100000:3.0:1782217023.567339:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714067072 00000100:00100000:3.0:1782217023.567442:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 160 00000100:00100000:3.0:1782217023.567455:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6454aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+23:11464:x1868789714067072:12345-192.168.203.19@tcp:101:bash.0 00010000:00010000:3.0:1782217023.567490:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217023.567516:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f64d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6204ce expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.567653:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f654 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.567673:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089f638 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204c0 expref: 24 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.567700:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f654 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.567743:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089f638 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204c0 expref: 24 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.567759:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089f638 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204c0 expref: 24 pid: 5783 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217023.567775:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a803b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5784:1868789733991296:192.168.203.19@tcp:104: 00000100:00100000:3.0:1782217023.567933:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64902e180 going to sleep for 11 seconds 00000100:00100000:3.0:1782217023.570829:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a803b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5784:1868789733991296:192.168.203.19@tcp:104: 00010000:00010000:3.0:1782217023.570869:0:5784:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f654 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217023.572974:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217023.573157:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714067200 00000100:00100000:0.0:1782217023.573169:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714067200 00010000:00010000:0.0:1782217023.573232:0:8299:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089f638 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204c0 expref: 25 pid: 5783 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217023.573315:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 67 00000100:00100000:0.0:1782217023.573333:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+25:2359:x1868789714067200:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217023.573352:0:8299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217023.573360:0:8299:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089f638 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204c0 expref: 25 pid: 5783 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217023.573372:0:8299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089f638 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204c0 expref: 25 pid: 5783 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217023.573397:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af600/0xf210a9075089f638 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204c0 expref: 25 pid: 5783 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217023.573415:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e650a64500) 00010000:00010000:0.0:1782217023.573421:0:8299:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f654 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217023.573430:0:8299:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f654 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217023.573439:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f654 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217023.573476:0:8299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217023.573538:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+24:2359:x1868789714067200:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 207us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217023.573546:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 67 00010000:00010000:3.0:1782217023.574336:0:5784:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f654 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.574349:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f654 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217023.574376:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1782217023.574580:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f64d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204ce expref: 25 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.574600:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f654 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204ce expref: 24 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.574624:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e650a64500) 00010000:00010000:3.0:1782217023.574627:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782217023.574630:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e653160e00, rc 0) 00000100:00100000:3.0:1782217023.574679:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6454aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+24:11464:x1868789714067072:12345-192.168.203.19@tcp:101:bash.0 Request processed in 7227us (9412us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1782217023.574687:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 160 00000100:00100000:2.0:1782217023.578798:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217023.579020:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714067456 00000100:00100000:1.0:1782217023.579033:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714067456 00000100:00100000:1.0:1782217023.579116:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 161 00000100:00100000:1.0:1782217023.579128:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+24:11464:x1868789714067456:12345-192.168.203.19@tcp:36:bash.0 00010000:00010000:1.0:1782217023.579765:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f662 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.579809:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f662 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.579824:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f662 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782217023.580160:0:6855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1782217023.580196:0:6855:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e18da29c reply state 00000000e23ae3cf transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f662 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217023.580208:0:6855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782217023.581082:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+27:11464:x1868789714067456:12345-192.168.203.19@tcp:36:bash.0 Request processed in 1932us (2275us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1782217023.581095:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 161 00000020:00080000:1.0:1782217023.581102:0:6855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1782217023.591574:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f662 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.591599:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f662 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.591608:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f662 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.591616:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217023.591622:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f662 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.591631:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f662 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.591672:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e650a64500) 00010000:00010000:1.0:1782217023.591675:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217023.591681:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f662 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.591688:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f662 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217023.594570:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217023.594709:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714067584 00000100:00100000:0.0:1782217023.594740:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714067584 00000100:00100000:0.0:1782217023.594811:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 162 00000100:00100000:0.0:1782217023.594823:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+26:11464:x1868789714067584:12345-192.168.203.19@tcp:101:bash.0 00010000:00010000:0.0:1782217023.594856:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217023.594925:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f669 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6204d5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217023.595043:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f670 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217023.595060:0:5783:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f654 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204ce expref: 27 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217023.595070:0:5783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f670 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217023.595117:0:5783:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f654 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204ce expref: 27 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217023.595133:0:5783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f654 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204ce expref: 27 pid: 5784 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217023.595150:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6508d8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5783:1868789733991424:192.168.203.19@tcp:104: 00000100:00100000:0.0:1782217023.595266:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6447dfa80 going to sleep for 11 seconds 00000100:00100000:0.0:1782217023.600853:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217023.601322:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714067712 00000100:00100000:3.0:1782217023.601335:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714067712 00010000:00010000:3.0:1782217023.601390:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f654 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204ce expref: 28 pid: 5784 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217023.601438:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 68 00000100:00100000:3.0:1782217023.601449:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+28:2359:x1868789714067712:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217023.601468:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217023.601475:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f654 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204ce expref: 28 pid: 5784 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.601489:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f654 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204ce expref: 28 pid: 5784 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.601517:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e650a64500) 00010000:00010000:3.0:1782217023.601523:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f670 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.601533:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f670 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.601563:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f670 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.601586:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217023.601897:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+28:2359:x1868789714067712:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 425us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217023.601908:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 68 00010000:00010000:1.0:1782217023.605742:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f654 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204ce expref: 27 pid: 5784 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217023.605781:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6508d8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5783:1868789733991424:192.168.203.19@tcp:104: 00010000:00010000:1.0:1782217023.605814:0:5783:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f670 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.605826:0:5783:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f670 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.605832:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f670 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217023.605916:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1782217023.605921:0:5783:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782217023.605948:0:5783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f670 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.606063:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a9075089f669 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204d5 expref: 27 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.606082:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f670 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204d5 expref: 26 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.606115:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e650a64500) 00010000:00010000:1.0:1782217023.606119:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782217023.606124:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437bc00, rc 0) 00000100:00100000:1.0:1782217023.606284:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+26:11464:x1868789714067584:12345-192.168.203.19@tcp:101:bash.0 Request processed in 11396us (11663us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217023.606296:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 162 00000100:00100000:0.0:1782217023.609224:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217023.609287:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714067968 00000100:00100000:1.0:1782217023.609300:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714067968 00000100:00100000:1.0:1782217023.609433:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 45 00000100:00100000:1.0:1782217023.609444:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+26:11464:x1868789714067968:12345-192.168.203.19@tcp:35:bash.0 00000100:00100000:1.0:1782217023.609783:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+27:11464:x1868789714067968:12345-192.168.203.19@tcp:35:bash.0 Request processed in 340us (572us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1782217023.609789:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 45 00000100:00100000:2.0:1782217023.712193:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217023.712282:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714068224 00000100:00100000:0.0:1782217023.712297:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714068224 00000100:00100000:0.0:1782217023.712424:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 163 00000100:00100000:0.0:1782217023.712454:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f18bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+27:11474:x1868789714068224:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:0.0:1782217023.712489:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217023.712517:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f677 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6204dc expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217023.712861:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1782217023.713143:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f677 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204dc expref: 29 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217023.713162:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e650a64300) 00010000:00010000:0.0:1782217023.713166:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782217023.713173:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f677 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204dc expref: 29 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217023.713189:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437a800, rc 0) 00000100:00100000:0.0:1782217023.713293:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f18bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+28:11474:x1868789714068224:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 842us (1114us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1782217023.713302:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 163 00000100:00100000:3.0:1782217023.721923:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217023.723315:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714068352 00000100:00100000:1.0:1782217023.723333:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714068352 00000100:00100000:1.0:1782217023.723413:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 164 00000100:00100000:1.0:1782217023.723425:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a803b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+28:11474:x1868789714068352:12345-192.168.203.19@tcp:34:lfs.0 00010000:00010000:1.0:1782217023.723555:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f685 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.723577:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f685 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.723590:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f685 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.723620:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f68c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.723629:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f68c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.723636:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f68c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.724113:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f693 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.724126:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f693 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.724134:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f693 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782217023.725593:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f693 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.725619:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f685 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.725628:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f685 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.725636:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f685 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.725643:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217023.725649:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f685 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.725680:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f685 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.725704:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88e67a811000) 00010000:00010000:1.0:1782217023.725708:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217023.725714:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f685 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.725720:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f685 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.725739:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f68c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.725744:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f68c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.725750:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f68c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.725754:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217023.725758:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f68c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.725764:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f68c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.725771:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88e67a811c00) 00010000:00010000:1.0:1782217023.725774:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217023.725776:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f68c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.725792:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f68c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.725810:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f693 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.725816:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f693 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.725822:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f693 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.725826:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06c00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217023.725828:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f693 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.725834:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f693 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.725841:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e650a64500) 00010000:00010000:1.0:1782217023.725843:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217023.725846:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f693 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.725850:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f693 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217023.726561:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a803b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+28:11474:x1868789714068352:12345-192.168.203.19@tcp:34:lfs.0 Request processed in 3128us (4642us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217023.726574:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 164 00000100:00100000:2.0:1782217023.733697:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217023.741281:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714068608 00000100:00100000:0.0:1782217023.741305:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714068608 00000100:00100000:0.0:1782217023.741408:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 46 00000100:00100000:0.0:1782217023.741421:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f18b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+28:11474:x1868789714068608:12345-192.168.203.19@tcp:35:lfs.0 00000100:00100000:0.0:1782217023.744965:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f18b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+29:11474:x1868789714068608:12345-192.168.203.19@tcp:35:lfs.0 Request processed in 3529us (11266us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1782217023.744984:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 46 00000100:00100000:3.0:1782217023.799130:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217023.802422:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714068864 00000100:00100000:1.0:1782217023.802445:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714068864 00000100:00100000:1.0:1782217023.802532:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 165 00000100:00100000:1.0:1782217023.802556:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a801880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+29:11477:x1868789714068864:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:1.0:1782217023.802589:0:6855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217023.802616:0:6855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f69a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6204e3 expref: -99 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.802729:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f6a1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.802748:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f6a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.802762:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f6a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.802780:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f6a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.802787:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f6a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.802795:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f6a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.803322:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f6af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.803334:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f6af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.803353:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f6af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217023.803367:0:6855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1782217023.803490:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f6a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.803499:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f6a1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.803506:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f6a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.803513:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217023.803518:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f6a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.803526:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f6a1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.803541:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88e67a811000) 00010000:00010000:1.0:1782217023.803545:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217023.803551:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f6a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.803556:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f6a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.803570:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f6a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.803576:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f6a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.803588:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f6a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.803594:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217023.803596:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f6a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.803603:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f6a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.803611:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88e67a811c00) 00010000:00010000:1.0:1782217023.803614:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217023.803617:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f6a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.803622:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f6a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.803678:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f69a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204e3 expref: 32 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.803694:0:6855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f6af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204e3 expref: 31 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.803701:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e650a64500) 00010000:00010000:1.0:1782217023.803703:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782217023.803706:0:6855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd07e00, rc 0) 00000100:00100000:1.0:1782217023.803801:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a801880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+31:11477:x1868789714068864:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 1247us (4687us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1782217023.803820:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 165 00000100:00100000:3.0:1782217023.807529:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217023.808793:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217023.808979:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714068992 00000100:00100000:0.0:1782217023.809009:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714068992 00000100:00100000:0.0:1782217023.809088:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 166 00000100:00100000:0.0:1782217023.809099:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f190000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+31:11477:x1868789714068992:12345-192.168.203.19@tcp:54:lfs.0 00010000:00010000:0.0:1782217023.809190:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f6bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217023.809210:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f6bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217023.809223:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f6bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217023.809269:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f6bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217023.809277:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f6bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217023.809284:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f6bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217023.809290:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437a800 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217023.809296:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f6bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217023.809304:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f6bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217023.809318:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e650a64500) 00010000:00010000:0.0:1782217023.809322:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782217023.809328:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f6bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217023.809346:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f6bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217023.809424:0:8300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714069120 00000100:00100000:2.0:1782217023.809431:0:8300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714069120 00000100:00100000:0.0:1782217023.809448:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f190000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+32:11477:x1868789714068992:12345-192.168.203.19@tcp:54:lfs.0 Request processed in 349us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217023.809459:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 166 00000100:00100000:2.0:1782217023.809477:0:8300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 12 00000100:00100000:2.0:1782217023.809487:0:8300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a800000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+31:2359:x1868789714069120:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217023.809502:0:8300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217023.809521:0:8300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f6af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204e3 expref: 31 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.809534:0:8300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e650a64500) 00010000:00010000:2.0:1782217023.809538:0:8300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217023.809561:0:8300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a800000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+30:2359:x1868789714069120:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 77us (2048us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217023.809568:0:8300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 12 00000100:00100000:3.0:1782217023.811560:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217023.811939:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714069376 00000100:00100000:1.0:1782217023.811952:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714069376 00000100:00100000:1.0:1782217023.812017:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 47 00000100:00100000:1.0:1782217023.812030:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+30:11477:x1868789714069376:12345-192.168.203.19@tcp:35:lfs.0 00000100:00100000:1.0:1782217023.812370:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+31:11477:x1868789714069376:12345-192.168.203.19@tcp:35:lfs.0 Request processed in 340us (820us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1782217023.812379:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 47 00000100:00100000:3.0:1782217023.981940:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217023.982052:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714069632 00000100:00100000:1.0:1782217023.982074:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714069632 00000100:00100000:1.0:1782217023.982153:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 167 00000100:00100000:1.0:1782217023.982165:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+31:11495:x1868789714069632:12345-192.168.203.19@tcp:101:cat.0 00010000:00010000:1.0:1782217023.982198:0:6855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217023.982223:0:6855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f6c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6204ea expref: -99 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.982367:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f6cb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.982384:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f6cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.982398:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f6cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217023.982410:0:6855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1782217023.982605:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f6c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204ea expref: 34 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.982650:0:6855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f6cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204ea expref: 33 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217023.982661:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e650a64500) 00010000:00010000:1.0:1782217023.982664:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1782217023.982668:0:6855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd06400, rc 0) 00000100:00100000:1.0:1782217023.982743:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+33:11495:x1868789714069632:12345-192.168.203.19@tcp:101:cat.0 Request processed in 581us (818us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1782217023.982750:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 167 00000100:00100000:2.0:1782217024.026151:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217024.026333:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714069760 00000100:00100000:0.0:1782217024.026347:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714069760 00000100:00100000:0.0:1782217024.026432:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 168 00000100:00100000:0.0:1782217024.026445:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f18ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+33:11496:x1868789714069760:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:0.0:1782217024.026476:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217024.026503:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f6d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6204f1 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.026589:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f6e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.026608:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f6e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.026621:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f6e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217024.026949:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1782217024.026954:0:5783:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1782217024.027039:0:5783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f6e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.027072:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f6d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204f1 expref: 35 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.027099:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f6e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204f1 expref: 34 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.027109:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88e67a811000) 00010000:00010000:0.0:1782217024.027113:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782217024.027116:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437a600, rc 0) 00000100:00100000:0.0:1782217024.027195:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f18ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+34:11496:x1868789714069760:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 753us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217024.027204:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 168 00000100:00100000:3.0:1782217024.032196:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217024.032320:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714070144 00000100:00100000:1.0:1782217024.032332:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714070144 00000100:00100000:1.0:1782217024.032401:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 48 00000100:00100000:1.0:1782217024.032412:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+34:11496:x1868789714070144:12345-192.168.203.19@tcp:35:lfs.0 00000100:00100000:1.0:1782217024.032829:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+35:11496:x1868789714070144:12345-192.168.203.19@tcp:35:lfs.0 Request processed in 417us (645us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1782217024.032839:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 48 00000100:00100000:3.0:1782217024.040640:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217024.040922:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714070272 00000100:00100000:0.0:1782217024.040935:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714070272 00000100:00100000:0.0:1782217024.041023:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 13 00000100:00100000:0.0:1782217024.041036:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f190a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+35:11496:x1868789714070272:12345-192.168.203.19@tcp:103:lfs.0 00010000:00010000:0.0:1782217024.041059:0:8299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1782217024.041090:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f670 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204d5 expref: 35 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.041114:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f6cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204ea expref: 34 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.041126:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640031600/0xf210a9075089f574 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620496 expref: 33 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.041137:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e650a64500) 00010000:00010000:0.0:1782217024.041150:0:8299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217024.041256:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f190a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+32:11496:x1868789714070272:12345-192.168.203.19@tcp:103:lfs.0 Request processed in 222us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217024.041273:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 13 00000100:00100000:2.0:1782217024.043281:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217024.043449:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714070400 00000100:00100000:3.0:1782217024.043460:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714070400 00000100:00100000:3.0:1782217024.043641:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 169 00000100:00100000:3.0:1782217024.043654:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+32:11496:x1868789714070400:12345-192.168.203.19@tcp:58:lfs.0 00010000:00010000:3.0:1782217024.043823:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f6e7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.043844:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f6e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.043858:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f6e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782217024.044331:0:6855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1782217024.044455:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+32:11496:x1868789714070400:12345-192.168.203.19@tcp:58:lfs.0 Request processed in 801us (1183us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217024.044466:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 169 00000040:00080000:3.0:1782217024.084236:0:11532:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782217024.084259:0:11532:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782217024.084303:0:11532:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1782217024.084313:0:11532:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782217024.084497:0:11532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f191f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11532:1868789733991552:192.168.203.19@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782217024.084705:0:11532:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64902ecc0 going to sleep for 11 seconds 00010000:00010000:2.0:1782217024.085079:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782217024.094576:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217024.095604:0:11532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f191f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11532:1868789733991552:192.168.203.19@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1782217024.096072:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714070528 00000100:00100000:0.0:1782217024.096083:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714070528 00000100:00100000:0.0:1782217024.096156:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 170 00000100:00100000:0.0:1782217024.096167:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+32:11498:x1868789714070528:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:0.0:1782217024.096194:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217024.096220:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f6ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6204f8 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.096315:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f6f5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.096331:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f6f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.096344:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f6f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.096360:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f6fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.096367:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f6fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.096374:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f6fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217024.100672:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217024.100784:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714070656 00000100:00100000:3.0:1782217024.100797:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714070656 00000100:00100000:3.0:1782217024.100870:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 171 00000100:00100000:3.0:1782217024.100899:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+34:11500:x1868789714070656:12345-192.168.203.19@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1782217024.100942:0:5785:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1782217024.101073:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+34:11500:x1868789714070656:12345-192.168.203.19@tcp:53:lhsmtool_posix.0 Request processed in 176us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217024.101082:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 171 00010000:00010000:0.0:1782217024.103262:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a9075089f703 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.103304:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a9075089f703 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.103320:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a9075089f703 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217024.104653:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1782217024.104665:0:5783:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782217024.104706:0:5783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a9075089f703 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.104725:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a9075089f703 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.104750:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f6f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.104757:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f6f5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.104765:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f6f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.104772:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437a800 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217024.104777:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f6f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.104786:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f6f5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.104803:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88e67a811000) 00010000:00010000:0.0:1782217024.104819:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217024.104842:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f6f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.104849:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f6f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.104870:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f6fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.104911:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f6fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.104919:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f6fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.104924:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437ae00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217024.104928:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f6fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.104950:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f6fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.104960:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88e647d05300) 00010000:00010000:0.0:1782217024.104963:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217024.104966:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f6fc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.104973:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f6fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.105028:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f6ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204f8 expref: 34 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.105060:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a9075089f703 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204f8 expref: 33 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.105068:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e660936900) 00010000:00010000:0.0:1782217024.105071:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782217024.105074:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437ac00, rc 0) 00000100:00100000:0.0:1782217024.105164:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+33:11498:x1868789714070528:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 8997us (10601us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217024.105174:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 170 00000100:00100000:2.0:1782217024.106161:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217024.106345:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714070784 00000100:00100000:0.0:1782217024.106357:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714070784 00000100:00100000:0.0:1782217024.106641:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 172 00000100:00100000:0.0:1782217024.106656:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+33:11500:x1868789714070784:12345-192.168.203.19@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1782217024.106743:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f70a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.106760:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f70a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.106773:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f70a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.106791:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f711 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.106798:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f711 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.106816:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f711 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.106847:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a9075089f718 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.106856:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a9075089f718 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.106863:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a9075089f718 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217024.106930:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1782217024.107199:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782217024.107215:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a9075089f718 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.107228:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f70a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.107234:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f70a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.107251:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f70a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.107257:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437aa00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217024.107262:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f70a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.107269:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f70a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.107290:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88e67a811700) 00010000:00010000:0.0:1782217024.107294:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217024.107299:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f70a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.107306:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f70a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.107319:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f711 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.107325:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f711 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.107330:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f711 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.107336:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437b200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217024.107338:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f711 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.107344:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f711 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.107351:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff88e647d05900) 00010000:00010000:0.0:1782217024.107353:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217024.107356:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f711 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.107362:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f711 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.107402:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a9075089f718 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.107409:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a9075089f718 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.107415:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a9075089f718 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.107420:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437b800 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217024.107423:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a9075089f718 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.108155:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a9075089f718 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.108170:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e660936900) 00010000:00010000:0.0:1782217024.108172:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217024.108176:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a9075089f718 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.108183:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a9075089f718 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217024.108294:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+33:11500:x1868789714070784:12345-192.168.203.19@tcp:34:lhsmtool_posix.0 Request processed in 1637us (2135us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217024.108306:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 172 00000100:00100000:2.0:1782217024.117525:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217024.117649:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714071040 00000100:00100000:1.0:1782217024.117661:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714071040 00000100:00100000:1.0:1782217024.117736:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 173 00000100:00100000:1.0:1782217024.117837:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+33:11500:x1868789714071040:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782217024.117863:0:6855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217024.117969:0:6855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f71f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6204ff expref: -99 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217024.118142:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f726 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217024.118158:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f726 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217024.118172:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f726 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217024.118185:0:6855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1782217024.118424:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f726 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217024.118432:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f726 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217024.118439:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f726 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217024.118446:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07a00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217024.118451:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f726 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217024.118459:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f726 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217024.118473:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e660936900) 00010000:00010000:1.0:1782217024.118476:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782217024.118482:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f726 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217024.118499:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f726 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217024.118551:0:6855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f71f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204ff expref: 35 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217024.118563:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88e67a811700) 00010000:00010000:1.0:1782217024.118565:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782217024.118570:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f71f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204ff expref: 35 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217024.118580:0:6855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd06200, rc 0) 00000100:00100000:1.0:1782217024.118703:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+34:11500:x1868789714071040:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 870us (1192us total) trans 4294967457 rc 301/301 00000100:00100000:1.0:1782217024.118712:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 173 00000100:00100000:3.0:1782217024.122398:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217024.122568:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714071168 00000100:00100000:0.0:1782217024.122580:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714071168 00000100:00100000:0.0:1782217024.122654:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 174 00000100:00100000:0.0:1782217024.122684:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f191f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+34:11500:x1868789714071168:12345-192.168.203.19@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782217024.122733:0:5784:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782217024.123064:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f191f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+34:11500:x1868789714071168:12345-192.168.203.19@tcp:53:lhsmtool_posix.0 Request processed in 382us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217024.123074:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 174 00000100:00100000:2.0:1782217024.129620:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217024.129939:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714071424 00000100:00100000:0.0:1782217024.129953:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714071424 00000100:00100000:0.0:1782217024.130032:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 175 00000100:00100000:0.0:1782217024.130046:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+34:11500:x1868789714071424:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782217024.130074:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217024.130078:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1782217024.130115:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f6e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204f1 expref: 34 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.130139:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88e67a811000) 00010000:00010000:0.0:1782217024.130146:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782217024.130162:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a9075089f734 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620506 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782217024.131605:0:5783:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1782217024.131996:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f73b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.132013:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f73b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.132023:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f73b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.132097:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a9075089f734 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620506 expref: 36 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.132112:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f73b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620506 expref: 35 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.132120:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88e647d05900) 00010000:00010000:0.0:1782217024.132122:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782217024.132124:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437b200, rc 0) 00000100:00100000:0.0:1782217024.132384:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+35:11500:x1868789714071424:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 2339us (2778us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1782217024.132395:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 175 00000100:00100000:2.0:1782217024.152045:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217024.152396:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714071680 00000100:00100000:3.0:1782217024.152409:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714071680 00000100:00100000:3.0:1782217024.152490:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 176 00000100:00100000:3.0:1782217024.152502:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+35:11500:x1868789714071680:12345-192.168.203.19@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782217024.152601:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217024.152637:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b200/0xf210a9075089f73b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620506 expref: 35 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.152673:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88e647d05900) 00010000:00010000:3.0:1782217024.152687:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782217024.152716:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f749 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.152733:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f749 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.153097:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f749 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217024.155425:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f750 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xc4fb4238 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217024.155456:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f750 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc4fb4238 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217024.155469:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f750 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc4fb4238 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217024.156009:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f749 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217024.156019:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f749 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217024.156026:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f749 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217024.156032:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e653160e00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217024.156038:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f749 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217024.156046:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f749 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217024.156062:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88e67a811000) 00010000:00010000:2.0:1782217024.156066:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217024.156070:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f749 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217024.156090:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a9075089f749 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217024.156108:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f750 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc4fb4238 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217024.156114:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f750 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc4fb4238 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217024.156121:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f750 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc4fb4238 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217024.156126:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738af400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217024.156131:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f750 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc4fb4238 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217024.156136:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f750 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc4fb4238 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217024.156145:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xc4fb4238 (ffff88e65417fb00) 00010000:00010000:2.0:1782217024.156148:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217024.156150:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f750 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc4fb4238 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217024.156156:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f750 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc4fb4238 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217024.158103:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+34:11500:x1868789714071680:12345-192.168.203.19@tcp:36:lhsmtool_posix.0 Request processed in 5586us (6056us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782217024.158119:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 176 00000100:00100000:3.0:1782217024.165773:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217024.165924:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714071808 00000100:00100000:1.0:1782217024.165933:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714071808 00000100:00100000:1.0:1782217024.165983:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 177 00000100:00100000:1.0:1782217024.165992:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f190700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+34:11500:x1868789714071808:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782217024.166014:0:6855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217024.166037:0:6855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f757 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62050d expref: -99 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217024.166069:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f75e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217024.166082:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f75e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217024.166106:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f75e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217024.166195:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f757 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62050d expref: 36 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217024.166212:0:6855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f75e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62050d expref: 35 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217024.166221:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88e67a811c00) 00010000:00010000:1.0:1782217024.166224:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782217024.166227:0:6855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd07a00, rc 0) 00000100:00100000:1.0:1782217024.166303:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f190700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+35:11500:x1868789714071808:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 312us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217024.166311:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 177 00000100:00100000:3.0:1782217024.175754:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217024.175842:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714072064 00000100:00100000:1.0:1782217024.175851:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714072064 00000100:00100000:1.0:1782217024.175934:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 178 00000100:00100000:1.0:1782217024.175945:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fcb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+35:11500:x1868789714072064:12345-192.168.203.19@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782217024.176038:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f765 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217024.176058:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f765 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217024.176070:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f765 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782217024.176419:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1782217024.176430:0:5784:0:(osp_sync.c:1862:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 343228552379ns, next at 344228550428ns, rc = 0 00000004:00010000:1.0:1782217024.176525:0:5784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000061994853 reply state 00000000bab969f4 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f765 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217024.176536:0:5784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782217024.176638:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fcb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+37:11500:x1868789714072064:12345-192.168.203.19@tcp:36:lhsmtool_posix.0 Request processed in 693us (891us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1782217024.176646:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 178 00010000:00010000:0.0:1782217024.179818:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f765 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.179834:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f765 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.179842:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f765 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.179850:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217024.179855:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f765 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.179864:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f765 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.179915:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88e67a811c00) 00010000:00010000:0.0:1782217024.179931:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782217024.179937:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f765 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.179944:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f765 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217024.183338:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217024.183435:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714072192 00000100:00100000:1.0:1782217024.183446:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714072192 00000100:00100000:1.0:1782217024.183500:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 179 00000100:00100000:1.0:1782217024.183510:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fcb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+36:11500:x1868789714072192:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782217024.183534:0:6855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217024.183556:0:6855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f76c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620514 expref: -99 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217024.183614:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f76c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620514 expref: 37 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217024.183628:0:6855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f76c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620514 expref: 37 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217024.183647:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88e67a811c00) 00010000:00010000:1.0:1782217024.183650:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782217024.183653:0:6855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd06c00, rc 0) 00000100:00100000:1.0:1782217024.183722:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fcb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+37:11500:x1868789714072192:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 213us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217024.183729:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 179 00000100:00100000:2.0:1782217024.196310:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217024.196497:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714072320 00000100:00100000:3.0:1782217024.196507:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714072320 00000100:00100000:3.0:1782217024.196580:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 52 00000100:00100000:3.0:1782217024.196590:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fca0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2358:x1868789714072320:12345-192.168.203.19@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1782217024.196961:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fca0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:2358:x1868789714072320:12345-192.168.203.19@tcp:2:lhsmtool_posix.0 Request processed in 370us (657us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1782217024.196970:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 52 00000100:00080000:0.0:1782217024.197041:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782217024.199457:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217024.199554:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714072576 00000100:00100000:1.0:1782217024.199563:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714072576 00000100:00100000:1.0:1782217024.199618:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 49 00000100:00100000:1.0:1782217024.199627:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fcb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+37:11500:x1868789714072576:12345-192.168.203.19@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1782217024.199866:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fcb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+38:11500:x1868789714072576:12345-192.168.203.19@tcp:35:lhsmtool_posix.0 Request processed in 238us (415us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1782217024.199874:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 49 00000100:00100000:1.0:1782217024.201990:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217024.202090:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714072832 00000100:00100000:2.0:1782217024.202104:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714072832 00000100:00100000:2.0:1782217024.202179:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 180 00000100:00100000:2.0:1782217024.202190:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f7a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+38:11500:x1868789714072832:12345-192.168.203.19@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1782217024.202306:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f7a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+38:11500:x1868789714072832:12345-192.168.203.19@tcp:57:lhsmtool_posix.0 Request processed in 118us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217024.202324:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 180 00000100:00100000:2.0:1782217024.205333:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217024.205433:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714072960 00000100:00100000:1.0:1782217024.205442:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714072960 00000100:00100000:1.0:1782217024.205494:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 181 00000100:00100000:1.0:1782217024.205502:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+38:11500:x1868789714072960:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782217024.205523:0:6855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217024.205543:0:6855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f773 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62051b expref: -99 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217024.205603:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f77a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217024.205616:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f77a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217024.205627:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f77a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217024.205678:0:6855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782217024.205696:0:6855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f77a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217024.205720:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f773 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62051b expref: 40 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217024.205736:0:6855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f77a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62051b expref: 39 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217024.205744:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88e67a811c00) 00010000:00010000:1.0:1782217024.205748:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1782217024.205751:0:6855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd07200, rc 0) 00000100:00100000:1.0:1782217024.205805:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+39:11500:x1868789714072960:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 303us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217024.205811:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 181 00000100:00100000:3.0:1782217024.207952:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217024.208234:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714073088 00000100:00100000:2.0:1782217024.208256:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714073088 00000100:00100000:2.0:1782217024.208328:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 53 00000100:00100000:2.0:1782217024.208340:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:2356:x1868789714073088:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782217024.208366:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217024.208394:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077f87fbe/0xf210a9075089f781 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620522 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782217024.208428:0:6580:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3a793f, blocks: 0x1 00010000:00010000:2.0:1782217024.208454:0:6580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=343s v=(0 0) 00010000:00010000:2.0:1782217024.208460:0:6580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217024.208472:0:6580:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077f87fbe/0xf210a9075089f781 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620522 expref: 8 pid: 6580 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217024.208495:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000077f87fbe/0xf210a9075089f781 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620522 expref: 8 pid: 6580 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217024.208539:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738af200, rc 0) 00000100:00100000:2.0:1782217024.208617:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+8:2356:x1868789714073088:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 278us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217024.208625:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 53 00000100:00100000:3.0:1782217024.219070:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217024.219298:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714073344 00000100:00100000:2.0:1782217024.219311:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714073344 00000100:00100000:2.0:1782217024.219388:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 182 00000100:00100000:2.0:1782217024.219401:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+39:11500:x1868789714073344:12345-192.168.203.19@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1782217024.219534:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+39:11500:x1868789714073344:12345-192.168.203.19@tcp:57:lhsmtool_posix.0 Request processed in 136us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217024.219543:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 182 00000100:00100000:1.0:1782217024.230085:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217024.230254:0:11864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714073472 00000100:00100000:2.0:1782217024.230263:0:11864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714073472 00000100:00100000:2.0:1782217024.230322:0:11864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 54 00000100:00100000:2.0:1782217024.230335:0:11864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+8:11500:x1868789714073472:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782217024.230354:0:11864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217024.230374:0:11864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9f353ff/0xf210a9075089f788 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620529 expref: -99 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217024.230403:0:11864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000077f87fbe/0xf210a9075089f781 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620522 expref: 9 pid: 6580 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217024.230412:0:11864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217024.230417:0:11864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217024.230431:0:11864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9f353ff/0xf210a9075089f788 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620529 expref: 9 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217024.230469:0:11864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000077f87fbe/0xf210a9075089f781 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620522 expref: 9 pid: 6580 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217024.230484:0:11864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000077f87fbe/0xf210a9075089f781 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620522 expref: 9 pid: 6580 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217024.230499:0:11864:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67fca3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11864:1868789733991680:192.168.203.19@tcp:104: 00000100:00100000:2.0:1782217024.230660:0:11864:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e647563900 going to sleep for 11 seconds 00000100:00100000:2.0:1782217024.240954:0:11864:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67fca3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11864:1868789733991680:192.168.203.19@tcp:104: 00010000:00010000:2.0:1782217024.240994:0:11864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a9f353ff/0xf210a9075089f788 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620529 expref: 9 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217024.241016:0:11864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738aea00, rc 0) 00000100:00100000:2.0:1782217024.241091:0:11864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+9:11500:x1868789714073472:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 10758us (11014us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217024.241101:0:11864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 54 00000100:00100000:0.0:1782217024.247564:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217024.247672:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714073600 00000100:00100000:2.0:1782217024.247688:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714073600 00010000:00010000:2.0:1782217024.248264:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000077f87fbe/0xf210a9075089f781 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620522 expref: 9 pid: 6580 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217024.248313:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 69 00000100:00100000:2.0:1782217024.248325:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64479a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+9:2357:x1868789714073600:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217024.248357:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217024.248380:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000077f87fbe/0xf210a9075089f781 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620522 expref: 9 pid: 6580 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217024.248395:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000077f87fbe/0xf210a9075089f781 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620522 expref: 9 pid: 6580 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217024.248418:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077f87fbe/0xf210a9075089f781 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620522 expref: 9 pid: 6580 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217024.248435:0:5769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217024.248439:0:5769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217024.248453:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a9f353ff/0xf210a9075089f788 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620529 expref: 8 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217024.248463:0:5769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9f353ff/0xf210a9075089f788 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620529 expref: 8 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217024.248504:0:5769:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a9f353ff/0xf210a9075089f788 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620529 expref: 8 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217024.248519:0:5769:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67fca3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5769:1868789733991808:192.168.203.19@tcp:105: 00000100:00100000:2.0:1782217024.248610:0:5769:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e647563900 going to sleep for 11 seconds 00000100:00100000:1.0:1782217024.264119:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217024.264212:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714073728 00000100:00100000:2.0:1782217024.264229:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714073728 00002000:00100000:2.0:1782217024.264322:0:6585:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff88e67f79c000 x1868789714073728/t0(0) o4->10ba4d21-74e8-42e8-8e52-48a327751cbd@192.168.203.19@tcp:275/0 lens 504/0 e 0 to 0 dl 1782217035 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782217024.264355:0:6585:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff88e67f79c000 with x1868789714073728 ext(0->8) 00002000:00010000:2.0:1782217024.264363:0:6585:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88e67f79c000 00000100:00100000:0.0:1782217024.264392:0:5769:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67fca3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5769:1868789733991808:192.168.203.19@tcp:105: 00000100:00100000:2.0:1782217024.264422:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 4 00010000:00010000:0.0:1782217024.264424:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217024.264438:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f79c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+9:2359:x1868789714073728:12345-192.168.203.19@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1782217024.264487:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64479a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+9:2357:x1868789714073600:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 16162us (16936us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217024.264500:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 69 00000100:00100000:2.0:1782217024.265279:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f79c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+10:2359:x1868789714073728:12345-192.168.203.19@tcp:4:lhsmtool_posix.0 Request processed in 838us (1162us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1782217024.265294:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 4 00002000:00100000:2.0:1782217024.265305:0:6585:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff88e67f79c000 x1868789714073728/t4294967314(0) o4->10ba4d21-74e8-42e8-8e52-48a327751cbd@192.168.203.19@tcp:275/0 lens 504/448 e 0 to 0 dl 1782217035 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782217024.265316:0:6585:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff88e67f79c000 with x1868789714073728 ext(0->8) 00002000:00010000:2.0:1782217024.265322:0:6585:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88e67f79c000 00000100:00100000:1.0:1782217024.281423:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217024.286485:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714073856 00000100:00100000:2.0:1782217024.286507:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714073856 00000100:00100000:2.0:1782217024.286620:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 183 00000100:00100000:2.0:1782217024.286634:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f79f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+39:11500:x1868789714073856:12345-192.168.203.19@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1782217024.347847:0:5805:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000100:00100000:2.0:1782217024.348029:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f79f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+35:11500:x1868789714073856:12345-192.168.203.19@tcp:44:lhsmtool_posix.0 Request processed in 61390us (66612us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217024.348043:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 183 00000020:00080000:3.0:1782217024.348587:0:5805:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:3.0:1782217024.348608:0:5805:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:3.0:1782217024.348619:0:5805:0:(osp_sync.c:1827:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:3.0:1782217024.348704:0:5817:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1782217024.348717:0:5817:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1782217024.348907:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782217024.348928:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67abcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733991936:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1782217024.348998:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217024.349206:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733991936 00000100:00100000:3.0:1782217024.350865:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733991936 00000100:00100000:3.0:1782217024.350982:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1782217024.350994:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67abcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733991936:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1782217024.351125:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1782217024.351270:0:6579:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1782217024.351275:0:6579:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1782217023 00002000:00010000:3.0:1782217024.351278:0:6579:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1782217024.351280:0:6579:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1782217023 -> 1782217023 00002000:00010000:3.0:1782217024.351283:0:6579:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1782217024.351387:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67abcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1868789733991936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 393us (2386us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1782217024.351397:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000004:00080000:1.0:1782217024.351605:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88e67abcf480/2, rc 0, transno 4294967315 00000100:00100000:1.0:1782217024.351614:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67abcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733991936:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1782217024.357126:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217024.357681:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714073984 00000100:00100000:3.0:1782217024.357696:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714073984 00000100:00100000:3.0:1782217024.357784:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 56 00000100:00100000:3.0:1782217024.357797:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+10:2358:x1868789714073984:12345-192.168.203.19@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1782217024.455093:0:7488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00080000:3.0:1782217024.455125:0:7488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:1.0:1782217024.459424:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:2358:x1868789714073984:12345-192.168.203.19@tcp:16:lhsmtool_posix.0 Request processed in 101615us (102299us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217024.459442:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 56 00000100:00100000:1.0:1782217024.463995:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217024.464450:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714074240 00000100:00100000:1.0:1782217024.464463:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714074240 00000100:00100000:1.0:1782217024.464537:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 184 00000100:00100000:1.0:1782217024.464551:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f79f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+18:11500:x1868789714074240:12345-192.168.203.19@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782217024.464626:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217024.464672:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f77a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62051b expref: 18 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217024.464692:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88e67a811c00) 00010000:00010000:1.0:1782217024.464698:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782217024.464838:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f78f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217024.464857:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f78f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217024.464868:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f78f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782217024.466464:0:5785:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000070d302d3 reply state 00000000af11f8c2 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f78f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217024.466483:0:5785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782217024.467889:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f79f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+19:11500:x1868789714074240:12345-192.168.203.19@tcp:36:lhsmtool_posix.0 Request processed in 3317us (3882us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1782217024.467904:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 184 00010000:00010000:3.0:1782217024.469120:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f78f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.469150:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f78f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.469157:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f78f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.469164:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217024.469169:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f78f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.469176:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f78f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.469192:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88e67a811c00) 00010000:00010000:3.0:1782217024.469196:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217024.469201:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f78f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.469207:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f78f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217024.475441:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217024.475526:0:11864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714074368 00000100:00100000:3.0:1782217024.475542:0:11864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714074368 00000100:00100000:3.0:1782217024.475617:0:11864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 57 00000100:00100000:3.0:1782217024.475630:0:11864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:2356:x1868789714074368:12345-192.168.203.19@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1782217024.475930:0:11864:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1782217024.475935:0:11864:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1782217023 -> 1782217022 00002000:00010000:3.0:1782217024.475938:0:11864:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1782217021 00002000:00010000:3.0:1782217024.475941:0:11864:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1782217023 -> 1782217022 00002000:00010000:3.0:1782217024.475955:0:11864:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1782217024.476103:0:11864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+8:2356:x1868789714074368:12345-192.168.203.19@tcp:2:lhsmtool_posix.0 Request processed in 475us (678us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1782217024.476111:0:11864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 57 00000100:00100000:0.0:1782217024.486048:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217024.486145:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714074624 00000100:00100000:3.0:1782217024.486155:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714074624 00000100:00100000:3.0:1782217024.486259:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 185 00000100:00100000:3.0:1782217024.486270:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+18:11500:x1868789714074624:12345-192.168.203.19@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1782217024.486353:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089f796 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.486371:0:5783:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f75e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62050d expref: 18 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.486380:0:5783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089f796 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.486414:0:5783:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f75e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62050d expref: 18 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.486428:0:5783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f75e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62050d expref: 18 pid: 6855 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217024.486443:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67abced80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5783:1868789733992064:192.168.203.19@tcp:104: 00000100:00100000:3.0:1782217024.486528:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e679faa900 going to sleep for 11 seconds 00000100:00100000:0.0:1782217024.497756:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217024.497788:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67abced80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5783:1868789733992064:192.168.203.19@tcp:104: 00010000:00010000:3.0:1782217024.497823:0:5783:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089f796 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217024.500424:0:8300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714074752 00000100:00100000:2.0:1782217024.500445:0:8300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714074752 00010000:00010000:2.0:1782217024.500506:0:8300:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f75e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62050d expref: 19 pid: 6855 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217024.500700:0:8300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 70 00000100:00100000:2.0:1782217024.500713:0:8300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+19:2358:x1868789714074752:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217024.500734:0:8300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217024.500743:0:8300:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f75e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62050d expref: 19 pid: 6855 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217024.500759:0:8300:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f75e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62050d expref: 19 pid: 6855 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217024.500786:0:8300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f75e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62050d expref: 19 pid: 6855 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217024.500801:0:8300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88e67a811c00) 00010000:00010000:2.0:1782217024.500807:0:8300:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089f796 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217024.500817:0:8300:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089f796 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217024.500825:0:8300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089f796 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217024.500857:0:8300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217024.500954:0:8300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+18:2358:x1868789714074752:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 244us (3220us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217024.500963:0:8300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 70 00010000:00010000:3.0:1782217024.501279:0:5783:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089f796 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.501297:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089f796 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.501340:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089f796 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.501348:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089f796 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.501355:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089f796 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.501361:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e682171e00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217024.501365:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089f796 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.501372:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089f796 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.501388:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88e67a811c00) 00010000:00010000:3.0:1782217024.501391:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1782217024.501395:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089f796 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.501401:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089f796 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217024.501485:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+17:11500:x1868789714074624:12345-192.168.203.19@tcp:55:lhsmtool_posix.0 Request processed in 15213us (15443us total) trans 0 rc -22/-22 00000100:00100000:3.0:1782217024.501510:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 185 00000100:00100000:1.0:1782217024.505010:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217024.505112:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714074880 00000100:00100000:3.0:1782217024.505126:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714074880 00000100:00100000:0.0:1782217024.505246:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 58 00000100:00100000:0.0:1782217024.505269:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f79f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+8:2359:x1868789714074880:12345-192.168.203.19@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1782217024.505333:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b2e69147/0xf210a9075089f79d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.505358:0:7991:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a9f353ff/0xf210a9075089f788 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620529 expref: 8 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.505368:0:7991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217024.505372:0:7991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782217024.505378:0:7991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2e69147/0xf210a9075089f79d lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.505443:0:7991:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a9f353ff/0xf210a9075089f788 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620529 expref: 8 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.505460:0:7991:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a9f353ff/0xf210a9075089f788 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620529 expref: 8 pid: 11864 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217024.505477:0:7991:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6508db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7991:1868789733992192:192.168.203.19@tcp:104: 00000100:00100000:0.0:1782217024.505581:0:7991:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e652ba5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782217024.514505:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217024.514567:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217024.514572:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714075136 00000100:00100000:3.0:1782217024.514588:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714075136 00000100:00100000:0.0:1782217024.514598:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217024.514657:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 88 00000100:00100000:3.0:1782217024.514670:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2356:x1868789714075136:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:3.0:1782217024.514758:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2356:x1868789714075136:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 91us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217024.514765:0:7991:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6508db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7991:1868789733992192:192.168.203.19@tcp:104: 00000100:00100000:3.0:1782217024.514778:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 88 00010000:00010000:0.0:1782217024.514812:0:7991:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b2e69147/0xf210a9075089f79d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217024.514816:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714075264 00000100:00100000:3.0:1782217024.514822:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714075264 00000100:00100000:3.0:1782217024.514863:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 148 00000100:00100000:3.0:1782217024.514872:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2356:x1868789714075264:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:3.0:1782217024.514944:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2356:x1868789714075264:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 72us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217024.514955:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 148 00000100:00100000:1.0:1782217024.514984:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714075008 00000100:00100000:1.0:1782217024.515003:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714075008 00000100:00100000:1.0:1782217024.515058:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 293 00000100:00100000:1.0:1782217024.515080:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2356:x1868789714075008:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:1.0:1782217024.515139:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2356:x1868789714075008:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 72us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217024.515148:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 293 00000100:00080000:1.0:1782217024.515188:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782217024.515195:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782217024.520868:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217024.520988:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714075392 00000100:00100000:0.0:1782217024.521005:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714075392 00010000:00010000:0.0:1782217024.521079:0:8299:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a9f353ff/0xf210a9075089f788 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620529 expref: 9 pid: 11864 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217024.521135:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 71 00000100:00100000:0.0:1782217024.521146:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67abced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+9:2358:x1868789714075392:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217024.521166:0:8299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217024.521194:0:8299:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a9f353ff/0xf210a9075089f788 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620529 expref: 9 pid: 11864 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.521229:0:8299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a9f353ff/0xf210a9075089f788 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620529 expref: 9 pid: 11864 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.521270:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9f353ff/0xf210a9075089f788 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620529 expref: 9 pid: 11864 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.521291:0:8299:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782217024.521296:0:8299:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782217024.521303:0:8299:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b2e69147/0xf210a9075089f79d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.521314:0:8299:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2e69147/0xf210a9075089f79d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.521351:0:8299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217024.521430:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67abced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+8:2358:x1868789714075392:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 284us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217024.521439:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 71 00010000:00010000:1.0:1782217024.521595:0:7991:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b2e69147/0xf210a9075089f79d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217024.521606:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2e69147/0xf210a9075089f79d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217024.521636:0:7991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b2e69147/0xf210a9075089f79d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217024.521646:0:7991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2e69147/0xf210a9075089f79d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217024.521663:0:7991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2e69147/0xf210a9075089f79d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217024.521672:0:7991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437ae00 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:1.0:1782217024.521677:0:7991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2e69147/0xf210a9075089f79d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217024.521701:0:7991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2e69147/0xf210a9075089f79d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217024.521714:0:7991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2e69147/0xf210a9075089f79d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217024.521721:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2e69147/0xf210a9075089f79d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217024.521787:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f79f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:2359:x1868789714074880:12345-192.168.203.19@tcp:1:lhsmtool_posix.0 Request processed in 16528us (16793us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217024.521797:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 58 00000100:00100000:1.0:1782217024.527859:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217024.527948:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714075648 00000100:00100000:0.0:1782217024.527971:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714075648 00000100:00100000:0.0:1782217024.528053:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 186 00000100:00100000:0.0:1782217024.528077:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f79df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+17:11500:x1868789714075648:12345-192.168.203.19@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1782217024.528184:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f7a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.528208:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f7a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.528252:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f7a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.528537:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f7ab lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.528550:0:6855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f76c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620514 expref: 18 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.528558:0:6855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f7ab lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.528602:0:6855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f76c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620514 expref: 18 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.528619:0:6855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f76c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620514 expref: 18 pid: 6855 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217024.528638:0:6855:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6508db100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6855:1868789733992320:192.168.203.19@tcp:104: 00000100:00100000:0.0:1782217024.528750:0:6855:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e652ba5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782217024.534396:0:6855:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6508db100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6855:1868789733992320:192.168.203.19@tcp:104: 00010000:00010000:1.0:1782217024.534428:0:6855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f7ab lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217024.535011:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217024.535075:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714075776 00000100:00100000:0.0:1782217024.535086:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714075776 00010000:00010000:0.0:1782217024.535140:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f76c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620514 expref: 19 pid: 6855 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217024.535184:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 72 00000100:00100000:0.0:1782217024.535195:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+19:2359:x1868789714075776:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217024.535251:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217024.535260:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f76c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620514 expref: 19 pid: 6855 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.535277:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f76c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620514 expref: 19 pid: 6855 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.535303:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f76c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620514 expref: 19 pid: 6855 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.535322:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88e67a811c00) 00010000:00010000:0.0:1782217024.535328:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f7ab lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.535338:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f7ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.535347:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f7ab lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.535376:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217024.535434:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+18:2359:x1868789714075776:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 241us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217024.535443:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 72 00010000:00010000:0.0:1782217024.535495:0:6855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f7ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.535503:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f7ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782217024.535780:0:6855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1782217024.535996:0:6855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1782217024.536050:0:6855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1782217024.536156:0:6855:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6508d8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6855:1868789733992448:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1782217024.536225:0:6855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217024.536276:0:6855:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e652ba56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782217024.536600:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733992448 00000100:00100000:3.0:1782217024.536609:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733992448 00000100:00100000:3.0:1782217024.536786:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782217024.536799:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a0e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6855:x1868789733992448:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1782217024.536942:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a0e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6855:x1868789733992448:12345-0@lo:1000:mdt00_003.0 Request processed in 146us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217024.536951:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782217024.537312:0:6855:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1782217024.537319:0:6855:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88e67abcf480, transno 4294967315 00000100:00100000:3.0:1782217024.537380:0:6855:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6508d8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6855:1868789733992448:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1782217024.537963:0:6855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1782217024.538054:0:6855:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67abcf100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6855:1868789733992576:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1782217024.538120:0:6855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217024.538151:0:6855:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e679faa0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782217024.538174:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733992576 00000100:00100000:3.0:1782217024.538180:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733992576 00000100:00100000:3.0:1782217024.538357:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782217024.538370:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67abcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6855:x1868789733992576:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1782217024.538585:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67abcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6855:x1868789733992576:12345-0@lo:1000:mdt00_003.0 Request processed in 218us (464us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1782217024.538593:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782217024.538643:0:6855:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67abcf100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6855:1868789733992576:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1782217024.538685:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f7ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.538697:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f7ab lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.538705:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f7ab lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.538713:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437aa00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217024.538719:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f7ab lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.538727:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f7ab lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.538759:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88e67a811c00) 00010000:00010000:3.0:1782217024.538762:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782217024.538768:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f7ab lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.538775:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437aa00/0xf210a9075089f7ab lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.538815:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f6e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.538822:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f6e7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.538828:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f6e7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.538832:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e653161c00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217024.538835:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f6e7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.538841:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f6e7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.538849:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e660936900) 00010000:00010000:3.0:1782217024.538851:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782217024.538854:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f6e7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.538860:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a9075089f6e7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.538947:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089f7b2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.538963:0:6855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a9075089f703 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204f8 expref: 21 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.538975:0:6855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089f7b2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.539012:0:6855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a9075089f703 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204f8 expref: 21 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.539027:0:6855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a9075089f703 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204f8 expref: 21 pid: 5783 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217024.539041:0:6855:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67abcca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6855:1868789733992704:192.168.203.19@tcp:104: 00000100:00100000:3.0:1782217024.539125:0:6855:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e652ba5600 going to sleep for 11 seconds 00000100:00100000:0.0:1782217024.558251:0:6855:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67abcca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6855:1868789733992704:192.168.203.19@tcp:104: 00010000:00010000:0.0:1782217024.558293:0:6855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089f7b2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217024.559261:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217024.559367:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714075904 00000100:00100000:2.0:1782217024.559455:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714075904 00010000:00010000:2.0:1782217024.559503:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a9075089f703 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204f8 expref: 22 pid: 5783 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217024.559558:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 73 00000100:00100000:2.0:1782217024.559568:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67abcc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+22:2358:x1868789714075904:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217024.559582:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217024.559588:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a9075089f703 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204f8 expref: 22 pid: 5783 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217024.559600:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a9075089f703 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204f8 expref: 22 pid: 5783 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217024.559622:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a9075089f703 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6204f8 expref: 22 pid: 5783 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217024.559639:0:5768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e660936900) 00010000:00010000:2.0:1782217024.559645:0:5768:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089f7b2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217024.559654:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089f7b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217024.559661:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089f7b2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217024.559750:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217024.559814:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67abcc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+21:2358:x1868789714075904:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 247us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217024.559833:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 73 00010000:00010000:0.0:1782217024.563685:0:6855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089f7b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.563702:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089f7b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.563717:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089f7b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.563723:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089f7b2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.563730:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089f7b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.563735:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e682171e00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217024.563740:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089f7b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.563747:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089f7b2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.563780:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e660936900) 00010000:00010000:0.0:1782217024.563783:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217024.563788:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089f7b2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.563795:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089f7b2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.563813:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f7a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.563819:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f7a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.563824:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f7a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.563828:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437bc00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217024.563830:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f7a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.563836:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f7a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.563842:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e660936900) 00010000:00010000:0.0:1782217024.563845:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782217024.563847:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f7a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.563853:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a9075089f7a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217024.564704:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f79df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+20:11500:x1868789714075648:12345-192.168.203.19@tcp:57:lhsmtool_posix.0 Request processed in 36632us (36846us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1782217024.564717:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 186 00000020:00080000:2.0:1782217024.564723:0:6855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1782217024.565093:0:11532:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782217024.565098:0:11532:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782217024.565738:0:11532:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1782217024.565751:0:11532:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782217024.571926:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217024.572019:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714076160 00000100:00100000:0.0:1782217024.572031:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714076160 00000100:00100000:0.0:1782217024.572084:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 50 00000100:00100000:0.0:1782217024.572094:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664e8c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+20:11500:x1868789714076160:12345-192.168.203.19@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1782217024.572850:0:5786:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1782217024.573016:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1782217024.573071:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a9075089f7b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.573088:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a9075089f7b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.573099:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a9075089f7b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.573108:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a9075089f7b9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.573114:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a9075089f7b9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.573119:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a9075089f7b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217024.573141:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782217024.573244:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664e8c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+22:11500:x1868789714076160:12345-192.168.203.19@tcp:35:lhsmtool_posix.0 Request processed in 1140us (1314us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1782217024.573254:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 50 00000020:00080000:0.0:1782217024.573259:0:5786:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782217024.574130:0:11515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217024.574142:0:11515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a9075089f7b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.574151:0:11515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437b800 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217024.574166:0:11515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a9075089f7b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.574174:0:11515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a9075089f7b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.574187:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88e647d05300) 00010000:00010000:3.0:1782217024.574190:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782217024.574194:0:11515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a9075089f7b9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.574201:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a9075089f7b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217024.574220:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217024.574223:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217024.574224:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217025.109029:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782217025.137954:0:12306:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782217025.137963:0:12306:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782217025.138004:0:12306:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:0.0:1782217025.138010:0:12306:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782217025.249148:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217025.252532:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714076416 00000100:00100000:3.0:1782217025.252548:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714076416 00000100:00100000:3.0:1782217025.252624:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 187 00000100:00100000:3.0:1782217025.252635:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f18b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+22:11519:x1868789714076416:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:3.0:1782217025.252660:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217025.252678:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089f7c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620530 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1782217025.252699:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782217025.253072:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170600/0xf210a9075089f7c7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217025.253088:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170600/0xf210a9075089f7c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217025.253110:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170600/0xf210a9075089f7c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217025.253122:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1782217025.253306:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089f7c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620530 expref: 25 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217025.253324:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170600/0xf210a9075089f7c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620530 expref: 24 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217025.253333:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88e67a811000) 00010000:00010000:3.0:1782217025.253337:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782217025.253340:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e682170600, rc 0) 00000100:00100000:3.0:1782217025.253741:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f18b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+24:11519:x1868789714076416:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 1106us (4600us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1782217025.253750:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 187 00000100:00100000:0.0:1782217025.260193:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217025.260697:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714076544 00000100:00100000:2.0:1782217025.260706:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714076544 00000100:00100000:2.0:1782217025.260753:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 188 00000100:00100000:2.0:1782217025.260762:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fcb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+24:11519:x1868789714076544:12345-192.168.203.19@tcp:34:lfs.0 00010000:00010000:2.0:1782217025.260842:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aea00/0xf210a9075089f7d5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.260860:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aea00/0xf210a9075089f7d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.260873:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aea00/0xf210a9075089f7d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.260902:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089f7dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.260909:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089f7dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.260915:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089f7dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.261752:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f7e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.261772:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f7e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.261781:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f7e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782217025.261826:0:5783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f7e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.261839:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aea00/0xf210a9075089f7d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.261846:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aea00/0xf210a9075089f7d5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.261852:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aea00/0xf210a9075089f7d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.261859:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738aea00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217025.261863:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aea00/0xf210a9075089f7d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.261871:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aea00/0xf210a9075089f7d5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.261910:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88e67a811000) 00010000:00010000:2.0:1782217025.261914:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217025.261918:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aea00/0xf210a9075089f7d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.261924:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aea00/0xf210a9075089f7d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.261940:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089f7dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.261945:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089f7dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.261951:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089f7dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.261955:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738afa00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217025.261958:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089f7dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.261963:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089f7dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.261969:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88e65417f700) 00010000:00010000:2.0:1782217025.261971:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217025.261973:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089f7dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.261978:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089f7dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.261992:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f7e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.261997:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f7e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.262002:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f7e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.262012:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738af200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217025.262101:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f7e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.262108:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f7e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.262116:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e65417fa00) 00010000:00010000:2.0:1782217025.262119:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217025.262121:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f7e3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.262127:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089f7e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217025.262201:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fcb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+24:11519:x1868789714076544:12345-192.168.203.19@tcp:34:lfs.0 Request processed in 1438us (2015us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217025.262210:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 188 00000100:00100000:3.0:1782217025.305971:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217025.306271:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714076800 00000100:00100000:1.0:1782217025.306281:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714076800 00000100:00100000:1.0:1782217025.306337:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 189 00000100:00100000:1.0:1782217025.306348:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67abcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+24:11522:x1868789714076800:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:1.0:1782217025.306369:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217025.306390:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f7ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620537 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.306476:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f7f1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.306492:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f7f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.306502:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f7f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.306516:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f7f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.306523:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f7f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.306529:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f7f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.306918:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f7ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.306927:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f7ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.306935:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f7ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217025.306945:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1782217025.307030:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f7f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.307037:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f7f1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.307049:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f7f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.307054:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217025.307059:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f7f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.307066:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f7f1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.307078:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88e67a811000) 00010000:00010000:1.0:1782217025.307081:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217025.307086:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f7f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.307091:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f7f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.307100:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f7f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.307106:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f7f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.307112:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f7f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.307117:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217025.307120:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f7f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.307133:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f7f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.307141:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88e67a811400) 00010000:00010000:1.0:1782217025.307143:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217025.307146:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f7f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.307152:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f7f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.307190:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f7ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620537 expref: 27 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.307202:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f7ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620537 expref: 26 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.307209:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e67a811100) 00010000:00010000:1.0:1782217025.307212:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782217025.307214:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd07e00, rc 0) 00000100:00100000:1.0:1782217025.307281:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67abcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+26:11522:x1868789714076800:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 936us (1320us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1782217025.307290:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 189 00000100:00100000:2.0:1782217025.320540:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217025.320692:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714076928 00000100:00100000:3.0:1782217025.320702:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714076928 00000100:00100000:3.0:1782217025.320754:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 190 00000100:00100000:3.0:1782217025.320765:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+26:11522:x1868789714076928:12345-192.168.203.19@tcp:54:lfs.0 00010000:00010000:3.0:1782217025.320833:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089f80d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217025.320849:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089f80d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217025.320861:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089f80d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217025.320918:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089f80d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217025.320925:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089f80d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217025.320932:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089f80d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217025.320938:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e682170400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217025.320942:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089f80d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217025.320948:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089f80d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217025.320960:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e67a811100) 00010000:00010000:3.0:1782217025.320963:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782217025.320966:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089f80d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217025.320972:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089f80d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217025.321042:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+26:11522:x1868789714076928:12345-192.168.203.19@tcp:54:lfs.0 Request processed in 279us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217025.321050:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 190 00000100:00100000:2.0:1782217025.329371:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217025.329452:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714077184 00000100:00100000:3.0:1782217025.329462:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714077184 00000100:00100000:3.0:1782217025.329518:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 51 00000100:00100000:3.0:1782217025.329542:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+26:11522:x1868789714077184:12345-192.168.203.19@tcp:35:lfs.0 00000100:00100000:3.0:1782217025.329772:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+27:11522:x1868789714077184:12345-192.168.203.19@tcp:35:lfs.0 Request processed in 231us (409us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1782217025.329780:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 51 00000100:00100000:3.0:1782217025.385273:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217025.385359:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714077440 00000100:00100000:0.0:1782217025.385369:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714077440 00000100:00100000:0.0:1782217025.385447:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 191 00000100:00100000:0.0:1782217025.385457:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67abcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+27:11056:x1868789714077440:12345-192.168.203.19@tcp:101:bash.0 00010000:00010000:0.0:1782217025.385478:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217025.385498:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a9075089f814 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62053e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.385608:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f81b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.385623:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f7ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620537 expref: 28 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.385633:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f81b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.385665:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f7ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620537 expref: 28 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.385678:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f7ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620537 expref: 28 pid: 5785 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217025.385691:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5784:1868789733992832:192.168.203.19@tcp:104: 00000100:00100000:0.0:1782217025.385798:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e650894780 going to sleep for 11 seconds 00000100:00100000:2.0:1782217025.389569:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217025.389667:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714077568 00000100:00100000:3.0:1782217025.389677:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714077568 00000100:00100000:0.0:1782217025.389718:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5784:1868789733992832:192.168.203.19@tcp:104: 00010000:00010000:3.0:1782217025.389720:0:8299:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f7ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620537 expref: 29 pid: 5785 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.389749:0:5784:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f81b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217025.389770:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 74 00000100:00100000:3.0:1782217025.389781:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fca0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+29:2358:x1868789714077568:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217025.389798:0:8299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217025.389806:0:8299:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f7ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620537 expref: 29 pid: 5785 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217025.389830:0:8299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f7ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620537 expref: 29 pid: 5785 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217025.389851:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f7ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620537 expref: 29 pid: 5785 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217025.389866:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e67a811100) 00010000:00010000:3.0:1782217025.389872:0:8299:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f81b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217025.390078:0:8299:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f81b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217025.390099:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f81b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.390167:0:8299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782217025.390273:0:5784:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f81b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.390281:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f81b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217025.390301:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1782217025.390441:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a9075089f814 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62053e expref: 30 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.390456:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f81b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62053e expref: 29 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.390463:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e67a811100) 00010000:00010000:0.0:1782217025.390465:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782217025.390468:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437a600, rc 0) 00000100:00100000:2.0:1782217025.390510:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fca0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+29:2358:x1868789714077568:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 730us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217025.390518:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 74 00000100:00100000:0.0:1782217025.390592:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67abcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+28:11056:x1868789714077440:12345-192.168.203.19@tcp:101:bash.0 Request processed in 5136us (5327us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1782217025.390600:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 191 00000100:00100000:0.0:1782217025.394564:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217025.394700:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714077824 00000100:00100000:3.0:1782217025.394709:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714077824 00000100:00100000:3.0:1782217025.394767:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 192 00000100:00100000:3.0:1782217025.394778:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+28:11056:x1868789714077824:12345-192.168.203.19@tcp:36:bash.0 00010000:00010000:3.0:1782217025.395191:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089f829 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217025.395207:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089f829 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217025.395218:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089f829 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782217025.395278:0:6855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1782217025.395306:0:6855:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dc0996bb reply state 0000000079fe7c88 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089f829 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217025.395314:0:6855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1782217025.395359:0:6855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1782217025.395985:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+32:11056:x1868789714077824:12345-192.168.203.19@tcp:36:bash.0 Request processed in 1196us (1417us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1782217025.395995:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 192 00000020:00080000:3.0:1782217025.396001:0:6855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1782217025.399319:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089f829 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.399337:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089f829 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.399359:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089f829 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.399365:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e682170400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217025.399370:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089f829 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.399378:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089f829 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.399394:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e67a811100) 00010000:00010000:0.0:1782217025.399398:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217025.399403:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089f829 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.399409:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089f829 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217025.399941:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217025.400062:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714077952 00000100:00100000:1.0:1782217025.400072:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714077952 00000100:00100000:1.0:1782217025.400127:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 193 00000100:00100000:1.0:1782217025.400137:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+31:11056:x1868789714077952:12345-192.168.203.19@tcp:101:bash.0 00010000:00010000:1.0:1782217025.406515:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217025.406559:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f830 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620545 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.406637:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f830 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620545 expref: 32 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.406652:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f830 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620545 expref: 32 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.406672:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e67a811100) 00010000:00010000:1.0:1782217025.406675:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782217025.406679:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd07200, rc 0) 00000100:00100000:1.0:1782217025.406751:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+32:11056:x1868789714077952:12345-192.168.203.19@tcp:101:bash.0 Request processed in 6614us (6814us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217025.406760:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 193 00000100:00100000:3.0:1782217025.412788:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217025.415039:0:11864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714078080 00000100:00100000:2.0:1782217025.415054:0:11864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714078080 00000100:00100000:2.0:1782217025.415125:0:11864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 59 00000100:00100000:2.0:1782217025.415135:0:11864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67abcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:11056:x1868789714078080:12345-192.168.203.19@tcp:101:bash.0 00010000:00010000:2.0:1782217025.415167:0:11864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217025.415189:0:11864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc741a3a/0xf210a9075089f837 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62054c expref: -99 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782217025.415216:0:11864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a3a793e, atime: 0x6a3a793d, ctime: 0x6a3a793e, blocks: 0xb 00010000:00010000:2.0:1782217025.415246:0:11864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=344s v=(0 0) 00010000:00010000:2.0:1782217025.415251:0:11864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217025.415259:0:11864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc741a3a/0xf210a9075089f837 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62054c expref: 8 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.415275:0:11864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cc741a3a/0xf210a9075089f837 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62054c expref: 8 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.415288:0:11864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738af600, rc 0) 00000100:00100000:2.0:1782217025.415359:0:11864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67abcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+8:11056:x1868789714078080:12345-192.168.203.19@tcp:101:bash.0 Request processed in 226us (2580us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217025.415366:0:11864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 59 00000100:00100000:0.0:1782217025.419317:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217025.419922:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714078208 00000100:00100000:1.0:1782217025.419931:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714078208 00002000:00010000:1.0:1782217025.419973:0:6583:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1782217025.419977:0:6583:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff88e67f193480 with x1868789714078208 ext(0->18446744073709551615) 00002000:00010000:1.0:1782217025.419989:0:6583:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88e67f193480. 00000100:00100000:1.0:1782217025.420017:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 5 00000100:00100000:1.0:1782217025.420026:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f193480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+8:2359:x1868789714078208:12345-192.168.203.19@tcp:10:bash.0 00002000:00010000:1.0:1782217025.420294:0:6583:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1782217025.420298:0:6583:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1782217022 -> 1782217024 00002000:00010000:1.0:1782217025.420301:0:6583:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1782217021 -> 1782217021 00002000:00010000:1.0:1782217025.420315:0:6583:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1782217022 -> 1782217024 00002000:00010000:1.0:1782217025.420317:0:6583:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1782217025.420376:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f193480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+9:2359:x1868789714078208:12345-192.168.203.19@tcp:10:bash.0 Request processed in 351us (1067us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1782217025.420384:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 5 00002000:00010000:1.0:1782217025.420388:0:6583:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1782217025.420390:0:6583:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff88e67f193480 with x1868789714078208 ext(0->18446744073709551615) 00002000:00010000:1.0:1782217025.420395:0:6583:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88e67f193480. 00000100:00100000:3.0:1782217025.492142:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67abcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1868789733993344:0@lo:400:kworker.0 00000100:00100000:1.0:1782217025.492309:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67abce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1868789733993088:0@lo:400:kworker.0 00000100:00100000:3.0:1782217025.492378:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217025.492453:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782217025.492460:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67abcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733993216:0@lo:400:kworker.0 00000100:00100000:3.0:1782217025.492486:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217025.492518:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733993216 00000100:00100000:3.0:1782217025.492525:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733993216 00000100:00100000:3.0:1782217025.492576:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1782217025.492585:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67abcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733993216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217025.492636:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67abcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733993216:12345-0@lo:400:kworker.0 Request processed in 52us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217025.492644:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1782217025.492681:0:3304:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:3.0:1782217025.492688:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:3.0:1782217025.492723:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88e664484380, transno 4294967307 00000100:00100000:1.0:1782217025.492811:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733993344 00000100:00100000:1.0:1782217025.492815:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733993344 00000100:00100000:1.0:1782217025.492848:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1782217025.492854:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67abcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868789733993344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217025.492910:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67abcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868789733993344:12345-0@lo:400:kworker.0 Request processed in 56us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217025.492916:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:1.0:1782217025.492933:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782217025.492937:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782217025.492945:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217025.492962:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67abcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733993600:0@lo:400:kworker.0 00000100:00100000:1.0:1782217025.492983:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217025.492999:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782217025.493004:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67abce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:526a4802-b871-4bcf-870f-067f11655366:3302:1868789733992960:0@lo:400:kworker.0 00000100:00100000:1.0:1782217025.493030:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217025.493051:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67abcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1868789733993472:0@lo:400:kworker.0 00000100:00100000:1.0:1782217025.493072:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217025.493104:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733993600 00000100:00100000:1.0:1782217025.493109:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733993600 00000100:00100000:1.0:1782217025.493132:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1782217025.493139:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f79c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3302:x1868789733993600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217025.493173:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f79c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3302:x1868789733993600:12345-0@lo:400:kworker.0 Request processed in 34us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217025.493179:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1782217025.493196:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733992960 00000100:00100000:1.0:1782217025.493199:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733992960 00000100:00100000:1.0:1782217025.493248:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1782217025.493254:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+19:3302:x1868789733992960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217025.493282:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+19:3302:x1868789733992960:12345-0@lo:400:kworker.0 Request processed in 29us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217025.493288:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1782217025.493312:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733993088 00000100:00100000:1.0:1782217025.493315:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733993088 00000100:00100000:1.0:1782217025.493333:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733993472 00000100:00100000:1.0:1782217025.493336:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733993472 00000100:00100000:1.0:1782217025.493354:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1782217025.493359:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f79ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1868789733993088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217025.493387:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f79ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1868789733993088:12345-0@lo:400:kworker.0 Request processed in 27us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217025.493392:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1782217025.493403:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1782217025.493409:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f79ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1868789733993472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217025.493435:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f79ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1868789733993472:12345-0@lo:400:kworker.0 Request processed in 25us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217025.493449:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:1.0:1782217025.493468:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782217025.493488:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67abce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:526a4802-b871-4bcf-870f-067f11655366:3302:1868789733992960:0@lo:400:kworker.0 00000100:00100000:1.0:1782217025.493499:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67abcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1868789733993472:0@lo:400:kworker.0 00000100:00100000:1.0:1782217025.493508:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67abce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1868789733993088:0@lo:400:kworker.0 00000100:00100000:1.0:1782217025.493518:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67abcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733993600:0@lo:400:kworker.0 00000100:00100000:3.0:1782217025.493903:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67abcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733993216:0@lo:400:kworker.0 00000100:00100000:3.0:1782217025.493920:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67abcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1868789733993344:0@lo:400:kworker.0 00000100:00100000:1.0:1782217025.498213:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217025.498681:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714078336 00000100:00100000:2.0:1782217025.498691:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714078336 00000100:00100000:2.0:1782217025.498759:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 194 00000100:00100000:2.0:1782217025.498768:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f79d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+32:11536:x1868789714078336:12345-192.168.203.19@tcp:34:lfs.0 00010000:00010000:2.0:1782217025.498838:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f83e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.498854:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f83e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.498921:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f83e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.498937:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f845 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.498945:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f845 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.498951:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f845 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.499248:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089f84c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.499258:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089f84c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.499266:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089f84c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782217025.499303:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089f84c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.499314:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f83e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.499320:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f83e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.499327:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f83e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.499343:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738af400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217025.499348:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f83e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.499356:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f83e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.499368:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88e67a811000) 00010000:00010000:2.0:1782217025.499371:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217025.499375:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f83e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.499381:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f83e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.499393:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f845 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.499399:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f845 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.499405:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f845 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.499410:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738ae800 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217025.499412:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f845 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.499418:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f845 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.499434:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88e65417f200) 00010000:00010000:2.0:1782217025.499436:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217025.499439:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f845 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.499445:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f845 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.499459:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089f84c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.499465:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089f84c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.499470:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089f84c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.499474:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738ae200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217025.499477:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089f84c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.499482:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089f84c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.499488:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e67a811100) 00010000:00010000:2.0:1782217025.499491:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217025.499494:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089f84c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.499499:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089f84c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217025.499576:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f79d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+32:11536:x1868789714078336:12345-192.168.203.19@tcp:34:lfs.0 Request processed in 807us (1371us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217025.499585:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 194 00000100:00100000:3.0:1782217025.540539:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217025.540651:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714078592 00000100:00100000:1.0:1782217025.540674:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714078592 00000100:00100000:1.0:1782217025.540746:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 195 00000100:00100000:1.0:1782217025.540756:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67abcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+32:11539:x1868789714078592:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:1.0:1782217025.540775:0:6855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217025.540794:0:6855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f853 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620553 expref: -99 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.540863:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f85a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.540919:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f85a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.540932:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f85a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.540947:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f861 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.540971:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f861 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.540978:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f861 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.541294:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f868 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.541304:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f868 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.541311:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f868 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217025.541321:0:6855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1782217025.541408:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f85a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.541416:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f85a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.541423:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f85a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.541429:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06c00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217025.541432:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f85a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.541440:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f85a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.541461:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88e67a811000) 00010000:00010000:1.0:1782217025.541464:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217025.541469:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f85a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.541475:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f85a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.541487:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f861 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.541493:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f861 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.541499:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f861 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.541504:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217025.541506:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f861 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.541512:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f861 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.541519:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88e67a811400) 00010000:00010000:1.0:1782217025.541521:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217025.541524:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f861 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.541529:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f861 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.541576:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f853 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620553 expref: 35 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.541589:0:6855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f868 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620553 expref: 34 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.541596:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e67a811100) 00010000:00010000:1.0:1782217025.541598:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1782217025.541601:0:6855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd07e00, rc 0) 00000100:00100000:1.0:1782217025.541657:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67abcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+34:11539:x1868789714078592:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 902us (1126us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1782217025.541665:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 195 00000100:00100000:0.0:1782217025.550979:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217025.551047:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714078720 00000100:00100000:2.0:1782217025.551056:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714078720 00000100:00100000:2.0:1782217025.551112:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 196 00000100:00100000:2.0:1782217025.551123:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+34:11539:x1868789714078720:12345-192.168.203.19@tcp:54:lfs.0 00010000:00010000:2.0:1782217025.551186:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f876 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.551216:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f81b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62053e expref: 34 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.551234:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f876 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.551270:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f81b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62053e expref: 34 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.551284:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f81b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62053e expref: 34 pid: 5784 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217025.551299:0:5785:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67fca0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1868789733993728:192.168.203.19@tcp:104: 00000100:00100000:2.0:1782217025.551384:0:5785:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6475630c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782217025.555015:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217025.555119:0:5785:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67fca0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1868789733993728:192.168.203.19@tcp:104: 00010000:00010000:1.0:1782217025.555145:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f876 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217025.555334:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714078976 00000100:00100000:3.0:1782217025.555342:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714078976 00000100:00100000:3.0:1782217025.555394:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 52 00000100:00100000:3.0:1782217025.555403:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+35:5569:x1868789714078976:12345-192.168.203.19@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1782217025.555936:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+36:5569:x1868789714078976:12345-192.168.203.19@tcp:35:ldlm_bl.0 Request processed in 532us (927us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1782217025.555944:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 52 00000100:00100000:3.0:1782217025.558953:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217025.559044:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714079104 00000100:00100000:0.0:1782217025.559053:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714079104 00010000:00010000:0.0:1782217025.559093:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f81b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62053e expref: 36 pid: 5784 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217025.559181:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 75 00000100:00100000:0.0:1782217025.559191:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67abcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+36:2359:x1868789714079104:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217025.559206:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217025.559242:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f81b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62053e expref: 36 pid: 5784 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.559256:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f81b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62053e expref: 36 pid: 5784 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.559278:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f81b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62053e expref: 36 pid: 5784 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.559293:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e67a811100) 00010000:00010000:0.0:1782217025.559298:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f876 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.559308:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.559316:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f876 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.559391:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217025.559446:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67abcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+35:2359:x1868789714079104:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 256us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217025.559454:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 75 00010000:00010000:1.0:1782217025.561000:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.561014:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.561049:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.561056:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f876 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.561080:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f876 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.561086:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738ae800 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217025.561090:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f876 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.561099:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f876 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.561113:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e67a811100) 00010000:00010000:1.0:1782217025.561116:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782217025.561120:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f876 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.561125:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f876 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217025.561616:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+34:11539:x1868789714078720:12345-192.168.203.19@tcp:54:lfs.0 Request processed in 10489us (10740us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217025.561627:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 196 00000100:00100000:0.0:1782217025.564799:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217025.565018:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714079360 00000100:00100000:2.0:1782217025.565027:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714079360 00000100:00100000:2.0:1782217025.565125:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 53 00000100:00100000:2.0:1782217025.565135:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+34:11539:x1868789714079360:12345-192.168.203.19@tcp:35:lfs.0 00000100:00100000:2.0:1782217025.565381:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+35:11539:x1868789714079360:12345-192.168.203.19@tcp:35:lfs.0 Request processed in 247us (687us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1782217025.565388:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 53 00000100:00100000:2.0:1782217025.694508:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217025.694626:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714079616 00000100:00100000:1.0:1782217025.694640:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714079616 00000100:00100000:1.0:1782217025.694772:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 197 00000100:00100000:1.0:1782217025.694783:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+35:11550:x1868789714079616:12345-192.168.203.19@tcp:101:cat.0 00010000:00010000:1.0:1782217025.694809:0:6855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217025.694829:0:6855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f87d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62055a expref: -99 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.694986:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f884 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.695001:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f884 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.695012:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f884 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.695033:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f88b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.695041:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f88b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.695048:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f88b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.695855:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f892 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.695868:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.695907:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217025.695918:0:6855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1782217025.696009:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f884 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.696017:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f884 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.696739:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f884 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.696745:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217025.696749:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f884 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.696758:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f884 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.696772:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88e67a811000) 00010000:00010000:1.0:1782217025.696776:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217025.696781:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f884 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.696788:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f884 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.696803:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f88b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.696809:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f88b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.696816:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f88b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.696821:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06c00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217025.696824:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f88b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.696841:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f88b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.696850:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88e67a811400) 00010000:00010000:1.0:1782217025.696852:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217025.696855:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f88b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.696862:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f88b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.696956:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f87d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62055a expref: 38 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.696971:0:6855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f892 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62055a expref: 37 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.696979:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e67a811100) 00010000:00010000:1.0:1782217025.696982:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782217025.696984:0:6855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd07a00, rc 0) 00000100:00100000:1.0:1782217025.697482:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+37:11550:x1868789714079616:12345-192.168.203.19@tcp:101:cat.0 Request processed in 2698us (2987us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1782217025.697492:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 197 00000100:00100000:3.0:1782217025.702141:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217025.702308:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714079872 00000100:00100000:0.0:1782217025.702323:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714079872 00000100:00100000:0.0:1782217025.702386:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 54 00000100:00100000:0.0:1782217025.702397:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67abcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+37:11550:x1868789714079872:12345-192.168.203.19@tcp:35:cat.0 00000100:00100000:0.0:1782217025.703012:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67abcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+38:11550:x1868789714079872:12345-192.168.203.19@tcp:35:cat.0 Request processed in 612us (884us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1782217025.703039:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 54 00000100:00100000:3.0:1782217025.724864:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217025.725160:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714080128 00000100:00100000:1.0:1782217025.725176:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714080128 00000100:00100000:1.0:1782217025.725262:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 198 00000100:00100000:1.0:1782217025.725273:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67abce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+38:11551:x1868789714080128:12345-192.168.203.19@tcp:36:rm.0 00010000:00010000:1.0:1782217025.725352:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1782217025.725379:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07a00/0xf210a9075089f892 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62055a expref: 38 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.725402:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07e00/0xf210a9075089f868 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620553 expref: 37 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.725416:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f830 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620545 expref: 36 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.725425:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e67a811100) 00010000:00010000:1.0:1782217025.725435:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782217025.725455:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f8a0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.725468:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f8a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.725477:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f8a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.725491:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f8a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.725498:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f8a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.725505:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f8a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.726978:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f8ae lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.726994:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f8ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.727005:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f8ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782217025.732258:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:1.0:1782217025.732278:0:5783:0:(osp_sync.c:1862:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 344784399962ns, next at 345784396874ns, rc = 0 00010000:00010000:1.0:1782217025.732364:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f8b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.732379:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f8b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.732390:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f8b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.732398:0:5783:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f8b5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.732403:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f8b5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.732409:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f8b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.732431:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782217025.732453:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f8ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.732468:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f8ae lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.732474:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f8ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.732481:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217025.732485:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f8ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.732493:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f8ae lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.732505:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e67a811a00) 00010000:00010000:1.0:1782217025.732508:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782217025.732513:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f8ae lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.732519:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f8ae lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.732538:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f8a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.732544:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f8a0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.732549:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f8a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.732554:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217025.732563:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f8a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.732569:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f8a0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.733198:0:11514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782217025.733206:0:11514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f8b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.733214:0:11514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06400 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:0.0:1782217025.733218:0:11514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f8b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.733233:0:11514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f8b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.733245:0:11514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88e67a811a00) 00010000:00010000:0.0:1782217025.733248:0:11514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782217025.733251:0:11514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f8b5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.733256:0:11514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f8b5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.733270:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217025.733272:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217025.733274:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217025.733524:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88e67a811000) 00010000:00010000:1.0:1782217025.733527:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217025.733530:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f8a0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.733537:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f8a0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782217025.733548:0:5783:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000090cca057 reply state 00000000df640357 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f8a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217025.733557:0:5783:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782217025.734300:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67abce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+37:11551:x1868789714080128:12345-192.168.203.19@tcp:36:rm.0 Request processed in 9022us (9444us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1782217025.734310:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 198 00010000:00010000:3.0:1782217025.736109:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f8a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217025.736132:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f8a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217025.736141:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f8a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217025.736149:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06c00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217025.736155:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f8a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217025.736165:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f8a7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217025.736184:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88e67a811400) 00010000:00010000:3.0:1782217025.736188:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217025.736194:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f8a7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217025.736201:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f8a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217025.765696:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217025.768074:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714080384 00000100:00100000:0.0:1782217025.768090:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714080384 00000100:00100000:0.0:1782217025.768169:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 199 00000100:00100000:0.0:1782217025.768180:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67abcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+36:11557:x1868789714080384:12345-192.168.203.19@tcp:101:bash.0 00010000:00010000:0.0:1782217025.768206:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217025.768236:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f8bc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620561 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.768384:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089f8c3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.768399:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089f8c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.768411:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089f8c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.768427:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f8ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.768434:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f8ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.768440:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f8ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782217025.769314:0:5784:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1782217025.769490:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f8d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.769502:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f8d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.769511:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f8d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.769552:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089f8c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.769570:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089f8c3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.770224:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089f8c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.770240:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437ba00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217025.770244:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089f8c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.770252:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089f8c3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.770266:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88e67a811000) 00010000:00010000:0.0:1782217025.770268:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217025.770272:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089f8c3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.770278:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089f8c3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782217025.770293:0:5784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c122a5bf reply state 00000000f6d97dfb transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f8ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217025.770301:0:5784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782217025.770335:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a600/0xf210a9075089f8bc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620561 expref: 39 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.770348:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f8d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620561 expref: 38 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.770369:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88e647d05800) 00010000:00010000:0.0:1782217025.770372:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782217025.770374:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437ae00, rc 0) 00000100:00100000:0.0:1782217025.770524:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67abcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+39:11557:x1868789714080384:12345-192.168.203.19@tcp:101:bash.0 Request processed in 2345us (4842us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1782217025.770533:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 199 00010000:00010000:0.0:1782217025.778867:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f8ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.778902:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f8ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.778910:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f8ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.778916:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437a800 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217025.778920:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f8ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.778927:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f8ca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.778943:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88e647d05400) 00010000:00010000:0.0:1782217025.778946:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217025.778950:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f8ca lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.778956:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a9075089f8ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217025.781709:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217025.781942:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714080512 00000100:00100000:0.0:1782217025.781958:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714080512 00000100:00100000:0.0:1782217025.782038:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 60 00000100:00100000:0.0:1782217025.782049:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67abce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2359:x1868789714080512:12345-192.168.203.19@tcp:101:bash.0 00010000:00010000:0.0:1782217025.782078:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217025.782097:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b1de308/0xf210a9075089f8df lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620568 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782217025.782122:0:6580:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782217025.782140:0:6580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=344s v=(0 0) 00010000:00010000:0.0:1782217025.782145:0:6580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217025.782162:0:6580:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b1de308/0xf210a9075089f8df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620568 expref: 6 pid: 6580 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.782181:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007b1de308/0xf210a9075089f8df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620568 expref: 6 pid: 6580 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.782194:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437aa00, rc 0) 00000100:00100000:0.0:1782217025.782267:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67abce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2359:x1868789714080512:12345-192.168.203.19@tcp:101:bash.0 Request processed in 220us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217025.782274:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 60 00000100:00100000:2.0:1782217025.787607:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217025.787770:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714080640 00000100:00100000:3.0:1782217025.787782:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714080640 00000100:00100000:3.0:1782217025.787856:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 61 00000100:00100000:3.0:1782217025.787867:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:11557:x1868789714080640:12345-192.168.203.19@tcp:101:bash.0 00010000:00010000:3.0:1782217025.787936:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217025.787979:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c473875b/0xf210a9075089f8e6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62056f expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217025.788022:0:6579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007b1de308/0xf210a9075089f8df lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620568 expref: 7 pid: 6580 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217025.788032:0:6579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217025.788037:0:6579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217025.788043:0:6579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c473875b/0xf210a9075089f8e6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62056f expref: 7 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217025.788087:0:6579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007b1de308/0xf210a9075089f8df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620568 expref: 7 pid: 6580 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217025.788103:0:6579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007b1de308/0xf210a9075089f8df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620568 expref: 7 pid: 6580 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217025.788120:0:6579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67abcca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6579:1868789733993856:192.168.203.19@tcp:104: 00000100:00100000:3.0:1782217025.788249:0:6579:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e646046180 going to sleep for 11 seconds 00000100:00100000:1.0:1782217025.791134:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217025.791244:0:8300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714080768 00000100:00100000:2.0:1782217025.791261:0:8300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714080768 00010000:00010000:2.0:1782217025.791323:0:8300:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007b1de308/0xf210a9075089f8df lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620568 expref: 8 pid: 6580 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217025.791390:0:8300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 76 00000100:00100000:2.0:1782217025.791404:0:8300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e644799c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+8:2359:x1868789714080768:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217025.791427:0:8300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1782217025.791449:0:6579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67abcca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6579:1868789733993856:192.168.203.19@tcp:104: 00010000:00010000:2.0:1782217025.791458:0:8300:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007b1de308/0xf210a9075089f8df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620568 expref: 8 pid: 6580 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217025.791486:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c473875b/0xf210a9075089f8e6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62056f expref: 8 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217025.791507:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e682171600, rc 0) 00000100:00100000:3.0:1782217025.791589:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+8:11557:x1868789714080640:12345-192.168.203.19@tcp:101:bash.0 Request processed in 3722us (3996us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217025.791637:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 61 00010000:00010000:2.0:1782217025.791649:0:8300:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007b1de308/0xf210a9075089f8df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620568 expref: 8 pid: 6580 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.791686:0:8300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b1de308/0xf210a9075089f8df lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620568 expref: 7 pid: 6580 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.791706:0:8300:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217025.791711:0:8300:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217025.791734:0:8300:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c473875b/0xf210a9075089f8e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62056f expref: 6 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.791745:0:8300:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c473875b/0xf210a9075089f8e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62056f expref: 6 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.791796:0:8300:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c473875b/0xf210a9075089f8e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62056f expref: 6 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217025.791813:0:8300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67fca2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8300:1868789733993984:192.168.203.19@tcp:105: 00000100:00100000:2.0:1782217025.792559:0:8300:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e647563a80 going to sleep for 11 seconds 00000100:00100000:1.0:1782217025.803942:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217025.803999:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714081024 00000100:00100000:0.0:1782217025.804017:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714081024 00000100:00100000:0.0:1782217025.804409:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 55 00000100:00100000:0.0:1782217025.804426:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f79d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+38:11557:x1868789714081024:12345-192.168.203.19@tcp:35:bash.0 00000001:00080000:0.0:1782217025.804858:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967483 00000100:00100000:0.0:1782217025.805057:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f79d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+40:11557:x1868789714081024:12345-192.168.203.19@tcp:35:bash.0 Request processed in 623us (1112us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1782217025.808709:0:8300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67fca2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8300:1868789733993984:192.168.203.19@tcp:105: 00010000:00010000:2.0:1782217025.809713:0:8300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217025.809793:0:8300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e644799c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2359:x1868789714080768:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 18388us (18662us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217025.809804:0:8300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 76 00000100:00100000:0.0:1782217025.812368:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 55 00000020:00080000:0.0:1782217025.812385:0:5787:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1782217025.928981:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217025.929486:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714081152 00000100:00100000:2.0:1782217025.929499:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714081152 00000100:00100000:2.0:1782217025.929783:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 200 00000100:00100000:2.0:1782217025.929797:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f79e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+40:11573:x1868789714081152:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:2.0:1782217025.929833:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217025.929862:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae600/0xf210a9075089f8ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620576 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.929982:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089f8f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.930023:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089f8f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.930039:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089f8f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217025.930440:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1782217025.930445:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1782217025.930473:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089f8f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.930506:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae600/0xf210a9075089f8ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620576 expref: 42 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.930530:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089f8f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620576 expref: 41 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.930540:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88e67a811000) 00010000:00010000:2.0:1782217025.930543:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782217025.930547:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738aec00, rc 0) 00000100:00100000:2.0:1782217025.930633:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f79e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+41:11573:x1868789714081152:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 838us (1666us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217025.930641:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 200 00000100:00100000:1.0:1782217025.937102:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217025.937287:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714081408 00000100:00100000:3.0:1782217025.937364:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714081408 00000100:00100000:3.0:1782217025.937474:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 201 00000100:00100000:3.0:1782217025.937488:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f79e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+41:11573:x1868789714081408:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:3.0:1782217025.937516:0:6855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217025.937541:0:6855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171400/0xf210a9075089f8fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62057d expref: -99 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217025.937675:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171200/0xf210a9075089f902 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217025.937693:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171200/0xf210a9075089f902 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217025.937707:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171200/0xf210a9075089f902 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217025.937720:0:6855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1782217025.937978:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171400/0xf210a9075089f8fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62057d expref: 44 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217025.938001:0:6855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171200/0xf210a9075089f902 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62057d expref: 43 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217025.938013:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88e647d05800) 00010000:00010000:3.0:1782217025.938016:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782217025.938021:0:6855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e682171200, rc 0) 00000100:00100000:3.0:1782217025.938120:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f79e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+43:11573:x1868789714081408:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 634us (1396us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1782217025.938130:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 201 00000100:00100000:1.0:1782217025.940988:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217025.941043:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217025.941289:0:8301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714081792 00000100:00100000:0.0:1782217025.941301:0:8301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714081792 00000100:00100000:0.0:1782217025.941382:0:8301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 14 00000100:00100000:0.0:1782217025.941394:0:8301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f79fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:10ba4d21-74e8-42e8-8e52-48a327751cbd+43:2359:x1868789714081792:12345-192.168.203.19@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782217025.941416:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714081664 00010000:00010000:0.0:1782217025.941417:0:8301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1782217025.941424:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714081664 00010000:00010000:0.0:1782217025.941452:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171200/0xf210a9075089f902 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62057d expref: 44 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.941478:0:8301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88e647d05800) 00000100:00100000:2.0:1782217025.941479:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 202 00010000:00010000:0.0:1782217025.941487:0:8301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217025.941493:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f79ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+43:11573:x1868789714081664:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:2.0:1782217025.941521:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217025.941556:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae600/0xf210a9075089f910 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620584 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217025.941557:0:8301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f79fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:10ba4d21-74e8-42e8-8e52-48a327751cbd+43:2359:x1868789714081792:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 164us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217025.941575:0:8301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 14 00010000:00010000:2.0:1782217025.941681:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aee00/0xf210a9075089f917 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.941711:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aee00/0xf210a9075089f917 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.941725:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aee00/0xf210a9075089f917 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217025.941739:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1782217025.941925:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae600/0xf210a9075089f910 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620584 expref: 45 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.941942:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aee00/0xf210a9075089f917 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620584 expref: 44 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.941949:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88e647d05800) 00010000:00010000:2.0:1782217025.941952:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1782217025.941954:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738aee00, rc 0) 00000100:00100000:2.0:1782217025.941999:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f79ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+44:11573:x1868789714081664:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 510us (1024us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1782217025.942006:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 202 00000100:00100000:1.0:1782217025.947644:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217025.947744:0:11864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714081920 00000100:00100000:2.0:1782217025.947757:0:11864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714081920 00000100:00100000:2.0:1782217025.947829:0:11864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 62 00000100:00100000:2.0:1782217025.947843:0:11864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f79c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+6:2358:x1868789714081920:12345-192.168.203.19@tcp:1:lfs.0 00010000:00010000:2.0:1782217025.947965:0:11864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a167e1b/0xf210a9075089f925 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.947992:0:11864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c473875b/0xf210a9075089f8e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62056f expref: 6 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.948004:0:11864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217025.948009:0:11864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782217025.948015:0:11864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a167e1b/0xf210a9075089f925 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.948073:0:11864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c473875b/0xf210a9075089f8e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62056f expref: 6 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.948098:0:11864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c473875b/0xf210a9075089f8e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62056f expref: 6 pid: 6579 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217025.948117:0:11864:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67fca0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11864:1868789733994112:192.168.203.19@tcp:104: 00000100:00100000:2.0:1782217025.948247:0:11864:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6475639c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782217025.954676:0:11864:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67fca0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11864:1868789733994112:192.168.203.19@tcp:104: 00010000:00010000:2.0:1782217025.954729:0:11864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a167e1b/0xf210a9075089f925 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217025.959680:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217025.959916:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714082048 00000100:00100000:0.0:1782217025.959930:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714082048 00002000:00100000:0.0:1782217025.959998:0:6584:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff88e67f79d880 x1868789714082048/t0(0) o4->10ba4d21-74e8-42e8-8e52-48a327751cbd@192.168.203.19@tcp:276/0 lens 504/0 e 0 to 0 dl 1782217036 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782217025.960010:0:6584:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff88e67f79d880 with x1868789714082048 ext(0->8) 00010000:00010000:0.0:1782217025.960021:0:6584:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c473875b/0xf210a9075089f8e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62056f expref: 7 pid: 6579 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.960085:0:6584:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c473875b/0xf210a9075089f8e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62056f expref: 7 pid: 6579 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782217025.960094:0:6584:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88e67f79d880 00000100:00100000:0.0:1782217025.960131:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 3 00000100:00100000:0.0:1782217025.960143:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f79d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:2359:x1868789714082048:12345-192.168.203.19@tcp:4:lfs.0 00000100:00100000:0.0:1782217025.961751:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f79d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+9:2359:x1868789714082048:12345-192.168.203.19@tcp:4:lfs.0 Request processed in 1598us (2075us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1782217025.961768:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 3 00002000:00100000:0.0:1782217025.961780:0:6584:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff88e67f79d880 x1868789714082048/t4294967308(0) o4->10ba4d21-74e8-42e8-8e52-48a327751cbd@192.168.203.19@tcp:276/0 lens 504/448 e 0 to 0 dl 1782217036 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782217025.961790:0:6584:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff88e67f79d880 with x1868789714082048 ext(0->8) 00010000:00010000:0.0:1782217025.961800:0:6584:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c473875b/0xf210a9075089f8e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62056f expref: 9 pid: 6579 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.961822:0:6584:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c473875b/0xf210a9075089f8e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62056f expref: 9 pid: 6579 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782217025.961831:0:6584:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88e67f79d880 00000100:00100000:0.0:1782217025.966829:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217025.967172:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714082176 00000100:00100000:2.0:1782217025.967186:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714082176 00010000:00010000:2.0:1782217025.967387:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c473875b/0xf210a9075089f8e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62056f expref: 9 pid: 6579 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217025.967496:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 77 00000100:00100000:2.0:1782217025.967508:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664484380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+9:2358:x1868789714082176:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217025.967530:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1782217025.967554:0:5769:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1782217025.967557:0:5769:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1782217025 00002000:00010000:2.0:1782217025.967559:0:5769:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1782217025 00002000:00010000:2.0:1782217025.967562:0:5769:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1782217025 00010000:00010000:2.0:1782217025.967568:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c473875b/0xf210a9075089f8e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62056f expref: 9 pid: 6579 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.967599:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c473875b/0xf210a9075089f8e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62056f expref: 9 pid: 6579 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.967632:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c473875b/0xf210a9075089f8e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62056f expref: 9 pid: 6579 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.967664:0:5769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=1s v=(1 0) 00010000:00010000:2.0:1782217025.967669:0:5769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782217025.967677:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a167e1b/0xf210a9075089f925 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.967688:0:5769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a167e1b/0xf210a9075089f925 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.967787:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217025.967870:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664484380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+8:2358:x1868789714082176:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 364us (1218us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217025.967920:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 77 00010000:00010000:1.0:1782217025.969717:0:11864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a167e1b/0xf210a9075089f925 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.969869:0:11864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a167e1b/0xf210a9075089f925 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.969931:0:11864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a167e1b/0xf210a9075089f925 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.969940:0:11864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a167e1b/0xf210a9075089f925 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.969950:0:11864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a167e1b/0xf210a9075089f925 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.969957:0:11864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738ae600 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:1.0:1782217025.969962:0:11864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a167e1b/0xf210a9075089f925 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.969972:0:11864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a167e1b/0xf210a9075089f925 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.969995:0:11864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a167e1b/0xf210a9075089f925 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.970004:0:11864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a167e1b/0xf210a9075089f925 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217025.970481:0:11864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f79c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:2358:x1868789714081920:12345-192.168.203.19@tcp:1:lfs.0 Request processed in 22633us (22844us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217025.970495:0:11864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 62 00000100:00100000:3.0:1782217025.973910:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217025.973982:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714082432 00000100:00100000:2.0:1782217025.973995:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714082432 00000100:00100000:2.0:1782217025.974063:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 56 00000100:00100000:2.0:1782217025.974074:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664e8e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+44:11573:x1868789714082432:12345-192.168.203.19@tcp:35:lfs.0 00000004:00010000:2.0:1782217025.974159:0:5786:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aee00/0xf210a9075089f917 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620584 expref: 44 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782217025.974516:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1782217025.974573:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1782217025.975817:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:2.0:1782217025.975933:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae400/0xf210a9075089f92c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.975957:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f8d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620561 expref: 48 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.975969:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae400/0xf210a9075089f92c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.976017:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f8d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620561 expref: 48 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.976049:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f8d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620561 expref: 48 pid: 5784 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217025.976069:0:5786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67fca0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5786:1868789733994240:192.168.203.19@tcp:104: 00000100:00100000:2.0:1782217025.978336:0:5786:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6475639c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782217025.992864:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217025.993005:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714082560 00000100:00100000:0.0:1782217025.993019:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714082560 00010000:00010000:0.0:1782217025.993070:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f8d1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620561 expref: 49 pid: 5784 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217025.993154:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 78 00000100:00100000:0.0:1782217025.993166:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67abcca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+49:2359:x1868789714082560:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217025.993185:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217025.993192:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f8d1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620561 expref: 49 pid: 5784 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.993207:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f8d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620561 expref: 49 pid: 5784 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.993243:0:5768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88e647d05800) 00010000:00010000:0.0:1782217025.993250:0:5768:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae400/0xf210a9075089f92c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.993261:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae400/0xf210a9075089f92c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.993270:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae400/0xf210a9075089f92c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217025.993293:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217025.993361:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67abcca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+49:2359:x1868789714082560:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 196us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217025.993370:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 78 00010000:00010000:2.0:1782217025.996422:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ae00/0xf210a9075089f8d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620561 expref: 48 pid: 5784 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217025.996455:0:5786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67fca0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5786:1868789733994240:192.168.203.19@tcp:104: 00010000:00010000:2.0:1782217025.996485:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae400/0xf210a9075089f92c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.996497:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae400/0xf210a9075089f92c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.996503:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae400/0xf210a9075089f92c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782217025.996720:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:2.0:1782217025.997008:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1782217025.997612:0:5786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67fca0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5786:1868789733994368:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1782217025.997702:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217025.997747:0:5786:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e647563e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782217025.997839:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733994368 00000100:00100000:3.0:1782217025.997849:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733994368 00000100:00100000:3.0:1782217025.997952:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782217025.997964:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5786:x1868789733994368:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1782217025.998074:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5786:x1868789733994368:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 111us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217025.998402:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782217025.998584:0:5786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67fca0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5786:1868789733994368:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1782217025.999493:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1782217025.999706:0:5786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67fca0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5786:1868789733994496:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1782217025.999839:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217025.999972:0:5786:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6475639c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782217026.000246:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733994496 00000100:00100000:1.0:1782217026.000255:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733994496 00000100:00100000:1.0:1782217026.000369:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782217026.000380:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5786:x1868789733994496:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1782217026.000615:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5786:x1868789733994496:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 237us (776us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1782217026.000623:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782217026.000695:0:5786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67fca0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5786:1868789733994496:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1782217026.000769:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1782217026.000811:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae400/0xf210a9075089f92c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.000835:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae400/0xf210a9075089f92c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.000844:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae400/0xf210a9075089f92c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.000851:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738ae400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217026.000857:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae400/0xf210a9075089f92c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.000865:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae400/0xf210a9075089f92c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.000923:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88e647d05800) 00010000:00010000:2.0:1782217026.000927:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1782217026.000931:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae400/0xf210a9075089f92c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.000937:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae400/0xf210a9075089f92c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782217026.001442:0:5786:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1782217026.001553:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1782217026.001566:0:5786:0:(osp_sync.c:1862:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 345053688324ns, next at 346053686544ns, rc = 0 00000001:00080000:2.0:1782217026.001573:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1782217026.001617:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88e647d05800) 00010000:00010000:2.0:1782217026.001620:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1782217026.001630:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aee00/0xf210a9075089f917 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620584 expref: 52 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217026.001951:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664e8e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+51:11573:x1868789714082432:12345-192.168.203.19@tcp:35:lfs.0 Request processed in 27876us (28078us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1782217026.001962:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 56 00000020:00080000:2.0:1782217026.001967:0:5786:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1782217026.005526:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217026.005651:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714082688 00000100:00100000:1.0:1782217026.005664:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714082688 00000100:00100000:3.0:1782217026.006023:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 203 00000100:00100000:3.0:1782217026.006038:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67abcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+51:11573:x1868789714082688:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:3.0:1782217026.006087:0:6855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217026.006118:0:6855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089f933 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62058b expref: -99 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.006199:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089f933 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62058b expref: 52 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.006216:0:6855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089f933 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62058b expref: 52 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.006254:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88e660936e00) 00010000:00010000:3.0:1782217026.006258:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782217026.006281:0:6855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e682171000, rc 0) 00000100:00100000:3.0:1782217026.006363:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67abcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+52:11573:x1868789714082688:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 329us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217026.006371:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 203 00000100:00100000:2.0:1782217026.007841:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733994624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782217026.007950:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217026.008106:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733994624 00000100:00100000:1.0:1782217026.008115:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733994624 00000100:00100000:1.0:1782217026.008182:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1782217026.008193:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a2a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1868789733994624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782217026.008256:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1782217026.008390:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782217026.008701:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a2a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1868789733994624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 509us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217026.008710:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1782217026.012037:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217026.012337:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714082944 00000100:00100000:1.0:1782217026.012351:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714082944 00000100:00100000:1.0:1782217026.012430:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 57 00000100:00100000:1.0:1782217026.012442:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+52:11573:x1868789714082944:12345-192.168.203.19@tcp:35:lfs.0 00000100:00100000:1.0:1782217026.012939:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+53:11573:x1868789714082944:12345-192.168.203.19@tcp:35:lfs.0 Request processed in 497us (914us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1782217026.012965:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 57 00000100:00100000:2.0:1782217026.015678:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733994624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782217026.111407:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217026.121836:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714083072 00000100:00100000:1.0:1782217026.121858:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714083072 00000100:00100000:1.0:1782217026.121973:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 204 00000100:00100000:1.0:1782217026.121986:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+53:11583:x1868789714083072:12345-192.168.203.19@tcp:34:lfs.0 00010000:00010000:1.0:1782217026.122090:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f93a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.122111:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f93a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.122125:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f93a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.122142:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f941 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.122149:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f941 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.122155:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f941 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.122295:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f948 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.122304:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f948 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.122311:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f948 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782217026.122386:0:5783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f948 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.122400:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f93a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.122407:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f93a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.122415:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f93a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.122421:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06c00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217026.122426:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f93a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.122434:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f93a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.122448:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88e67a811000) 00010000:00010000:1.0:1782217026.122451:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217026.122456:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f93a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.122462:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f93a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.122479:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f941 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.122484:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f941 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.122497:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f941 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.122502:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217026.122505:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f941 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.122510:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f941 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.122518:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88e67a811100) 00010000:00010000:1.0:1782217026.122521:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217026.122523:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f941 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.122529:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f941 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.122544:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f948 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.122551:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f948 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.122557:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f948 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.122562:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217026.122565:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f948 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.122581:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f948 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.122591:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88e660936e00) 00010000:00010000:1.0:1782217026.122593:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217026.122596:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f948 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.122602:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f948 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217026.122778:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+53:11583:x1868789714083072:12345-192.168.203.19@tcp:34:lfs.0 Request processed in 791us (11383us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217026.122788:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 204 00010000:00010000:2.0:1782217026.132196:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217026.176988:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217026.177180:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714083328 00000100:00100000:1.0:1782217026.177193:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714083328 00000100:00100000:1.0:1782217026.177276:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 205 00000100:00100000:1.0:1782217026.177288:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67abcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+53:11586:x1868789714083328:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:1.0:1782217026.177318:0:6855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217026.177346:0:6855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f94f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620592 expref: -99 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.177497:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f956 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.177517:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f956 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.177530:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f956 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.177554:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f95d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.177561:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f95d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.177568:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f95d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.178072:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f964 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.178085:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.178094:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217026.178106:0:6855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1782217026.178245:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f956 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.178254:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f956 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.178262:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f956 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.178269:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217026.178275:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f956 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.178294:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f956 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.178311:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88e67a811000) 00010000:00010000:1.0:1782217026.178315:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217026.178320:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f956 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.178327:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089f956 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.178344:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f95d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.178350:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f95d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.178356:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f95d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.178362:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06c00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217026.178788:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f95d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.178801:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f95d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.178811:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88e67a811100) 00010000:00010000:1.0:1782217026.178814:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217026.178817:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f95d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.178839:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089f95d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.180288:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06200/0xf210a9075089f94f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620592 expref: 56 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.180323:0:6855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f964 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620592 expref: 55 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.180333:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88e660936e00) 00010000:00010000:3.0:1782217026.180337:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782217026.180340:0:6855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd07400, rc 0) 00000100:00100000:3.0:1782217026.180560:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67abcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+55:11586:x1868789714083328:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 3270us (3584us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1782217026.180571:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 205 00000100:00100000:0.0:1782217026.188920:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217026.192460:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714083456 00000100:00100000:3.0:1782217026.192492:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714083456 00000100:00100000:3.0:1782217026.192586:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 206 00000100:00100000:3.0:1782217026.192597:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+55:11586:x1868789714083456:12345-192.168.203.19@tcp:54:lfs.0 00010000:00010000:3.0:1782217026.192689:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171400/0xf210a9075089f972 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.192709:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171400/0xf210a9075089f972 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.192724:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171400/0xf210a9075089f972 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.192776:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171400/0xf210a9075089f972 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.192783:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171400/0xf210a9075089f972 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.192790:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171400/0xf210a9075089f972 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.192797:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e682171400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217026.192801:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171400/0xf210a9075089f972 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.192809:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171400/0xf210a9075089f972 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.192822:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88e660936e00) 00010000:00010000:3.0:1782217026.192825:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782217026.192830:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171400/0xf210a9075089f972 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.192835:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171400/0xf210a9075089f972 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217026.192971:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+55:11586:x1868789714083456:12345-192.168.203.19@tcp:54:lfs.0 Request processed in 374us (4065us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217026.192980:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 206 00000100:00100000:2.0:1782217026.201405:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217026.201667:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714083712 00000100:00100000:3.0:1782217026.201681:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714083712 00000100:00100000:3.0:1782217026.201753:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 58 00000100:00100000:3.0:1782217026.201784:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+55:11586:x1868789714083712:12345-192.168.203.19@tcp:35:lfs.0 00000100:00100000:3.0:1782217026.202153:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+56:11586:x1868789714083712:12345-192.168.203.19@tcp:35:lfs.0 Request processed in 371us (762us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1782217026.202162:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 58 00000100:00100000:0.0:1782217026.306984:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217026.307295:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714083968 00000100:00100000:2.0:1782217026.307309:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714083968 00000100:00100000:2.0:1782217026.307386:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 207 00000100:00100000:2.0:1782217026.307398:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+56:11596:x1868789714083968:12345-192.168.203.19@tcp:101:bash.0 00010000:00010000:2.0:1782217026.307438:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217026.307442:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1782217026.307477:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089f8f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620576 expref: 56 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.307838:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88e67a811000) 00010000:00010000:2.0:1782217026.307845:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782217026.307864:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae400/0xf210a9075089f979 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620599 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.308055:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afe00/0xf210a9075089f980 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.308078:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afe00/0xf210a9075089f980 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.308090:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afe00/0xf210a9075089f980 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217026.308105:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1782217026.308276:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae400/0xf210a9075089f979 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620599 expref: 58 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.308292:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afe00/0xf210a9075089f980 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620599 expref: 57 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.308301:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88e660936e00) 00010000:00010000:2.0:1782217026.308304:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782217026.308307:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738afe00, rc 0) 00000100:00100000:2.0:1782217026.308386:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+57:11596:x1868789714083968:12345-192.168.203.19@tcp:101:bash.0 Request processed in 990us (1418us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1782217026.308395:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 207 00000100:00100000:0.0:1782217026.316863:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217026.316954:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217026.317204:0:8301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714084096 00000100:00100000:2.0:1782217026.317217:0:8301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714084096 00000100:00100000:2.0:1782217026.317308:0:8301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 15 00000100:00100000:2.0:1782217026.317319:0:8301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a807b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:10ba4d21-74e8-42e8-8e52-48a327751cbd+57:2358:x1868789714084096:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217026.317338:0:8301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217026.317370:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afe00/0xf210a9075089f980 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620599 expref: 57 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.317426:0:8301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88e660936e00) 00010000:00010000:2.0:1782217026.317433:0:8301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217026.317510:0:8301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a807b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:10ba4d21-74e8-42e8-8e52-48a327751cbd+56:2358:x1868789714084096:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 191us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217026.317518:0:8301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 15 00000100:00100000:3.0:1782217026.317673:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714084352 00000100:00100000:3.0:1782217026.317678:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714084352 00000100:00100000:3.0:1782217026.317721:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 208 00000100:00100000:3.0:1782217026.317728:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+56:11596:x1868789714084352:12345-192.168.203.19@tcp:36:bash.0 00010000:00010000:3.0:1782217026.317798:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217026.317813:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089f964 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620592 expref: 56 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.317826:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88e660936e00) 00010000:00010000:3.0:1782217026.317830:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782217026.318161:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171400/0xf210a9075089f98e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.318179:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171400/0xf210a9075089f98e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.318190:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171400/0xf210a9075089f98e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782217026.318261:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:3.0:1782217026.318300:0:5785:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008a14b5b9 reply state 000000004f7a27aa transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171400/0xf210a9075089f98e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217026.318310:0:5785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782217026.318389:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+58:11596:x1868789714084352:12345-192.168.203.19@tcp:36:bash.0 Request processed in 655us (1429us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1782217026.318406:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 208 00000020:00080000:3.0:1782217026.318411:0:5785:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782217026.324540:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171400/0xf210a9075089f98e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.324564:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171400/0xf210a9075089f98e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.324573:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171400/0xf210a9075089f98e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.324581:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e682171400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217026.324587:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171400/0xf210a9075089f98e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.324597:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171400/0xf210a9075089f98e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.324618:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88e660936e00) 00010000:00010000:3.0:1782217026.324623:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217026.324629:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171400/0xf210a9075089f98e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.324706:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171400/0xf210a9075089f98e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217026.325513:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217026.325782:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714084480 00000100:00100000:3.0:1782217026.325795:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714084480 00000100:00100000:3.0:1782217026.326052:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 209 00000100:00100000:3.0:1782217026.326065:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+57:11596:x1868789714084480:12345-192.168.203.19@tcp:101:bash.0 00010000:00010000:3.0:1782217026.326195:0:6855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217026.326232:0:6855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171600/0xf210a9075089f995 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6205a0 expref: -99 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.326363:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171200/0xf210a9075089f99c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.326378:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171200/0xf210a9075089f99c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.326391:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171200/0xf210a9075089f99c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217026.326429:0:6855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1782217026.326434:0:6855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782217026.326456:0:6855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171200/0xf210a9075089f99c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.326487:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171600/0xf210a9075089f995 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205a0 expref: 59 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.326509:0:6855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171200/0xf210a9075089f99c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205a0 expref: 58 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.326519:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88e660936e00) 00010000:00010000:3.0:1782217026.326522:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782217026.326526:0:6855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e682171200, rc 0) 00000100:00100000:3.0:1782217026.326599:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+58:11596:x1868789714084480:12345-192.168.203.19@tcp:101:bash.0 Request processed in 536us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217026.326607:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 209 00000100:00100000:1.0:1782217026.338621:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217026.343451:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714084736 00000100:00100000:3.0:1782217026.343475:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714084736 00000100:00100000:1.0:1782217026.343698:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 59 00000100:00100000:1.0:1782217026.343715:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f79d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+58:11596:x1868789714084736:12345-192.168.203.19@tcp:35:bash.0 00000100:00100000:1.0:1782217026.344549:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f79d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+59:11596:x1868789714084736:12345-192.168.203.19@tcp:35:bash.0 Request processed in 832us (5936us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1782217026.344560:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 59 00000100:00100000:0.0:1782217026.412436:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217026.412555:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714084864 00000100:00100000:2.0:1782217026.412568:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714084864 00000100:00100000:2.0:1782217026.412642:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 210 00000100:00100000:2.0:1782217026.412665:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+59:11602:x1868789714084864:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:2.0:1782217026.412696:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217026.412959:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afe00/0xf210a9075089f9a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6205a7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.413056:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae400/0xf210a9075089f9aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.413074:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae400/0xf210a9075089f9aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.413087:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae400/0xf210a9075089f9aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217026.413170:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1782217026.413174:0:5783:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1782217026.413281:0:5783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae400/0xf210a9075089f9aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.413315:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afe00/0xf210a9075089f9a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205a7 expref: 61 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.413358:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae400/0xf210a9075089f9aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205a7 expref: 60 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.413368:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88e67a811000) 00010000:00010000:2.0:1782217026.413372:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782217026.413376:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738ae400, rc 0) 00000100:00100000:2.0:1782217026.413562:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+60:11602:x1868789714084864:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 909us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217026.413570:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 210 00000100:00100000:0.0:1782217026.421115:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217026.421278:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714084992 00000100:00100000:2.0:1782217026.421292:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714084992 00000100:00100000:2.0:1782217026.421407:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 211 00000100:00100000:2.0:1782217026.421420:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+60:11602:x1868789714084992:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:2.0:1782217026.421447:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217026.421473:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089f9b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6205ae expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.421554:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f9b8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.421571:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f9b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.421584:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f9b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.421611:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f9bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.421635:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f9bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.421642:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f9bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.421949:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089f9c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.421960:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089f9c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.421968:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089f9c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217026.422012:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1782217026.422017:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782217026.422040:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089f9c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.422053:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089f9c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.422062:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f9b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.422069:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f9b8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.422076:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f9b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.422094:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738ae800 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217026.422099:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f9b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.422108:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f9b8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.422123:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88e67a811000) 00010000:00010000:2.0:1782217026.422126:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217026.422132:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f9b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.422139:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae800/0xf210a9075089f9b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.422155:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f9bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.422161:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f9bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.422167:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f9bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.422172:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738af400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217026.422175:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f9bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.422181:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f9bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.422432:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88e65417f200) 00010000:00010000:2.0:1782217026.422436:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217026.422439:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f9bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.422446:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089f9bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.422489:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089f9b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205ae expref: 62 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.422503:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089f9c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205ae expref: 61 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.422511:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88e660936e00) 00010000:00010000:2.0:1782217026.422513:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782217026.422515:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738ae200, rc 0) 00000100:00100000:2.0:1782217026.422668:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+61:11602:x1868789714084992:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 1239us (1553us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217026.422677:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 211 00000100:00100000:0.0:1782217026.428068:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217026.428206:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217026.428624:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714085376 00000100:00100000:1.0:1782217026.428638:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714085376 00000100:00100000:1.0:1782217026.428925:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 16 00000100:00100000:1.0:1782217026.428939:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648547800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+61:2357:x1868789714085376:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782217026.428962:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217026.428996:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae200/0xf210a9075089f9c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205ae expref: 61 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.429021:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88e660936e00) 00010000:00010000:1.0:1782217026.429028:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782217026.429158:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648547800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+60:2357:x1868789714085376:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 222us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217026.429167:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 16 00000100:00100000:3.0:1782217026.429406:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714085248 00000100:00100000:3.0:1782217026.429414:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714085248 00000100:00100000:3.0:1782217026.429456:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 212 00000100:00100000:3.0:1782217026.429465:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648546300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+60:11602:x1868789714085248:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:3.0:1782217026.429484:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217026.429504:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171600/0xf210a9075089f9cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6205b5 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.429625:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171400/0xf210a9075089f9d4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.429642:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171200/0xf210a9075089f99c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205a0 expref: 61 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.429651:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171400/0xf210a9075089f9d4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.429706:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171200/0xf210a9075089f99c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205a0 expref: 61 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.429730:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171200/0xf210a9075089f99c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205a0 expref: 61 pid: 6855 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217026.429746:0:5785:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67abced80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1868789733994752:192.168.203.19@tcp:104: 00000100:00100000:3.0:1782217026.429826:0:5785:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e646046180 going to sleep for 11 seconds 00000100:00100000:0.0:1782217026.435355:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217026.435581:0:5785:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67abced80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1868789733994752:192.168.203.19@tcp:104: 00010000:00010000:3.0:1782217026.435616:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171400/0xf210a9075089f9d4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217026.436038:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714085504 00000100:00100000:2.0:1782217026.436048:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714085504 00010000:00010000:2.0:1782217026.436091:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171200/0xf210a9075089f99c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205a0 expref: 62 pid: 6855 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217026.436168:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 79 00000100:00100000:2.0:1782217026.436179:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648547100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+62:2358:x1868789714085504:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217026.436219:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217026.436236:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171200/0xf210a9075089f99c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205a0 expref: 62 pid: 6855 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.436250:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171200/0xf210a9075089f99c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205a0 expref: 62 pid: 6855 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.436277:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171200/0xf210a9075089f99c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205a0 expref: 62 pid: 6855 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.436294:0:5768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88e660936e00) 00010000:00010000:2.0:1782217026.436299:0:5768:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171400/0xf210a9075089f9d4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.436310:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171400/0xf210a9075089f9d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.436318:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171400/0xf210a9075089f9d4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.436354:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217026.437354:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648547100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+61:2358:x1868789714085504:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 1168us (2011us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217026.437368:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 79 00010000:00010000:0.0:1782217026.437447:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171400/0xf210a9075089f9d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.437459:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171400/0xf210a9075089f9d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217026.437483:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1782217026.437693:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171600/0xf210a9075089f9cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205b5 expref: 62 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.437715:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171400/0xf210a9075089f9d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205b5 expref: 61 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.437734:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88e660936e00) 00010000:00010000:0.0:1782217026.437738:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782217026.437741:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e682171400, rc 0) 00000100:00100000:0.0:1782217026.437793:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648546300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+61:11602:x1868789714085248:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 8330us (9741us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1782217026.437801:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 212 00000100:00100000:0.0:1782217026.441390:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217026.441476:0:8301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714085760 00000100:00100000:2.0:1782217026.441489:0:8301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714085760 00000100:00100000:2.0:1782217026.441597:0:8301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 17 00000100:00100000:2.0:1782217026.441609:0:8301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e646ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:10ba4d21-74e8-42e8-8e52-48a327751cbd+61:11602:x1868789714085760:12345-192.168.203.19@tcp:103:lfs.0 00010000:00010000:2.0:1782217026.441654:0:8301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217026.441698:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089f933 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62058b expref: 61 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.441731:0:8301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88e660936e00) 00010000:00010000:2.0:1782217026.441737:0:8301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217026.441807:0:8301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e646ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:10ba4d21-74e8-42e8-8e52-48a327751cbd+60:11602:x1868789714085760:12345-192.168.203.19@tcp:103:lfs.0 Request processed in 200us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217026.441815:0:8301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 17 00000100:00100000:3.0:1782217026.444102:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217026.444142:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714085888 00000100:00100000:3.0:1782217026.444152:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714085888 00000100:00100000:3.0:1782217026.444242:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 213 00000100:00100000:3.0:1782217026.444254:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67abced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+60:11602:x1868789714085888:12345-192.168.203.19@tcp:58:lfs.0 00010000:00010000:3.0:1782217026.444388:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089f9e2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.444409:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089f9e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.444423:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089f9e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782217026.444685:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1782217026.444786:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67abced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+60:11602:x1868789714085888:12345-192.168.203.19@tcp:58:lfs.0 Request processed in 533us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217026.444796:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 213 00000100:00100000:0.0:1782217026.447115:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217026.447375:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714086016 00000100:00100000:1.0:1782217026.447387:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714086016 00000100:00100000:1.0:1782217026.447483:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 214 00000100:00100000:1.0:1782217026.447494:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648546d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+60:11602:x1868789714086016:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:1.0:1782217026.447525:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217026.447551:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f9e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6205bc expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.447621:0:5783:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089f9e2 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.447634:0:5783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f9e9 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205bc expref: 61 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.447668:0:5783:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089f9e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.447685:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f9e9 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205bc expref: 61 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.447700:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88e660936e00) 00010000:00010000:1.0:1782217026.447703:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782217026.447708:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f9e9 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205bc expref: 61 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.447716:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd07200, rc 0) 00000100:00100000:1.0:1782217026.447797:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648546d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+61:11602:x1868789714086016:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 305us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217026.447805:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 214 00000040:00080000:3.0:1782217026.644238:0:11532:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782217026.644251:0:11532:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782217026.644308:0:11532:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 5 00000040:00080000:3.0:1782217026.644322:0:11532:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782217026.644495:0:11532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67abcc380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11532:1868789733994880:192.168.203.19@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782217026.644642:0:11532:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e646046180 going to sleep for 11 seconds 00000100:00100000:3.0:1782217026.650015:0:11532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67abcc380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11532:1868789733994880:192.168.203.19@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1782217026.650125:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217026.655946:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714086144 00000100:00100000:2.0:1782217026.655967:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714086144 00000100:00100000:2.0:1782217026.656071:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 215 00000100:00100000:2.0:1782217026.656083:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+61:11604:x1868789714086144:12345-192.168.203.19@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1782217026.656156:0:5784:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1782217026.656325:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+61:11604:x1868789714086144:12345-192.168.203.19@tcp:53:lhsmtool_posix.0 Request processed in 242us (6202us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217026.656333:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 215 00000100:00100000:0.0:1782217026.662127:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217026.662314:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714086272 00000100:00100000:3.0:1782217026.662328:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714086272 00000100:00100000:3.0:1782217026.662424:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 216 00000100:00100000:3.0:1782217026.662435:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+61:11604:x1868789714086272:12345-192.168.203.19@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1782217026.662544:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089f9f0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.662565:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089f9f0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.662578:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089f9f0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.662595:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171600/0xf210a9075089f9f7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.662602:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171600/0xf210a9075089f9f7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.662607:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171600/0xf210a9075089f9f7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.662632:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089f9fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.662639:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089f9fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.662646:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089f9fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217026.662697:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1782217026.662702:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782217026.662716:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089f9fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.662736:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089f9f0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.662742:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089f9f0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.662767:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089f9f0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.662776:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e682171e00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217026.662782:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089f9f0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.662791:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089f9f0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.662809:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88e67a811700) 00010000:00010000:3.0:1782217026.662812:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217026.662818:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089f9f0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.662825:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089f9f0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.662845:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171600/0xf210a9075089f9f7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.662852:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171600/0xf210a9075089f9f7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.662858:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171600/0xf210a9075089f9f7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.662870:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e682171600 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217026.662873:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171600/0xf210a9075089f9f7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.662941:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171600/0xf210a9075089f9f7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.662950:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff88e660936500) 00010000:00010000:3.0:1782217026.662952:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217026.662955:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171600/0xf210a9075089f9f7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.662960:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171600/0xf210a9075089f9f7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.662976:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089f9fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.662983:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089f9fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.662988:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089f9fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.662993:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e682171000 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217026.662996:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089f9fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.663002:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089f9fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.663020:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88e660936e00) 00010000:00010000:3.0:1782217026.663023:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217026.663026:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089f9fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.663037:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089f9fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217026.663137:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+61:11604:x1868789714086272:12345-192.168.203.19@tcp:34:lhsmtool_posix.0 Request processed in 702us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217026.663146:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 216 00000100:00100000:0.0:1782217026.666968:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217026.670033:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714086528 00000100:00100000:2.0:1782217026.670052:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714086528 00000100:00100000:2.0:1782217026.670361:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 217 00000100:00100000:2.0:1782217026.670375:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648547100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+61:11604:x1868789714086528:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782217026.670401:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217026.670427:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089fa05 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6205c3 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.670558:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089fa0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.670593:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089fa0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.670607:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089fa0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217026.670621:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1782217026.670765:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089fa0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.670773:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089fa0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.670780:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089fa0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.670787:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738af400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217026.670792:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089fa0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.670801:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089fa0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.670815:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88e660936e00) 00010000:00010000:2.0:1782217026.670818:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782217026.670824:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089fa0c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.670830:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089fa0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.670925:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089fa05 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205c3 expref: 63 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.670945:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88e67a811700) 00010000:00010000:2.0:1782217026.670947:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782217026.670952:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089fa05 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205c3 expref: 63 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.670964:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738aec00, rc 0) 00000100:00100000:2.0:1782217026.671048:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648547100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+62:11604:x1868789714086528:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 676us (4094us total) trans 4294967504 rc 301/301 00000100:00100000:2.0:1782217026.671056:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 217 00000100:00100000:1.0:1782217026.681617:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217026.682335:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714086656 00000100:00100000:2.0:1782217026.682349:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714086656 00000100:00100000:2.0:1782217026.682474:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 218 00000100:00100000:2.0:1782217026.682488:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f79fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+62:11604:x1868789714086656:12345-192.168.203.19@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1782217026.682549:0:5783:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1782217026.682684:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f79fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+62:11604:x1868789714086656:12345-192.168.203.19@tcp:53:lhsmtool_posix.0 Request processed in 198us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217026.682694:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 218 00000100:00100000:0.0:1782217026.690923:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217026.691210:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714086912 00000100:00100000:3.0:1782217026.691231:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714086912 00000100:00100000:3.0:1782217026.691300:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 219 00000100:00100000:3.0:1782217026.691311:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+62:11604:x1868789714086912:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782217026.691337:0:6855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217026.691341:0:6855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1782217026.691375:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae400/0xf210a9075089f9aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205a7 expref: 62 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.691397:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88e67a811000) 00010000:00010000:3.0:1782217026.691403:0:6855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782217026.691418:0:6855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089fa1a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6205ca expref: -99 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782217026.692003:0:6855:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:3.0:1782217026.693597:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171600/0xf210a9075089fa21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.693637:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171600/0xf210a9075089fa21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.693793:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171600/0xf210a9075089fa21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.694026:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089fa1a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205ca expref: 64 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.694207:0:6855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171600/0xf210a9075089fa21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205ca expref: 63 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.694228:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88e660936500) 00010000:00010000:3.0:1782217026.694231:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782217026.694235:0:6855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e682171600, rc 0) 00000100:00100000:3.0:1782217026.694412:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+63:11604:x1868789714086912:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 3100us (3538us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1782217026.694423:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 219 00000100:00100000:0.0:1782217026.703802:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217026.704039:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714087168 00000100:00100000:3.0:1782217026.704052:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714087168 00000100:00100000:3.0:1782217026.704132:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 220 00000100:00100000:3.0:1782217026.704144:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+63:11604:x1868789714087168:12345-192.168.203.19@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782217026.704241:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217026.704275:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171600/0xf210a9075089fa21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205ca expref: 63 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.704301:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88e660936500) 00010000:00010000:3.0:1782217026.704331:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782217026.704358:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089fa2f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.704373:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089fa2f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.704385:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089fa2f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.704400:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089fa36 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xef3fa82 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.704408:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089fa36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xef3fa82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.704414:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089fa36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xef3fa82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.704512:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089fa2f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.704520:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089fa2f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.704528:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089fa2f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.704534:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e682171000 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217026.704540:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089fa2f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.704548:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089fa2f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.704565:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88e67a811000) 00010000:00010000:3.0:1782217026.704568:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217026.704572:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089fa2f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.704579:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089fa2f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.704590:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089fa36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xef3fa82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.704596:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089fa36 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xef3fa82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.704602:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089fa36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xef3fa82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.704608:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e682171e00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217026.704611:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089fa36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xef3fa82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.704617:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089fa36 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xef3fa82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.704624:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xef3fa82 (ffff88e660936100) 00010000:00010000:3.0:1782217026.704626:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217026.704629:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089fa36 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xef3fa82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.704635:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089fa36 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xef3fa82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217026.705345:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+62:11604:x1868789714087168:12345-192.168.203.19@tcp:36:lhsmtool_posix.0 Request processed in 1195us (1551us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782217026.705358:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 220 00000100:00100000:1.0:1782217026.716354:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217026.716461:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714087296 00000100:00100000:2.0:1782217026.716475:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714087296 00000100:00100000:2.0:1782217026.716544:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 221 00000100:00100000:2.0:1782217026.716556:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a802300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+62:11604:x1868789714087296:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782217026.716583:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217026.716612:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089fa3d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6205d1 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.716686:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089fa44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.716704:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089fa44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.716727:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089fa44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.716845:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089fa3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205d1 expref: 64 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.716868:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089fa44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205d1 expref: 63 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.716912:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88e65417f200) 00010000:00010000:2.0:1782217026.716916:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782217026.716920:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738af400, rc 0) 00000100:00100000:2.0:1782217026.716993:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a802300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+63:11604:x1868789714087296:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 439us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217026.717000:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 221 00000100:00100000:1.0:1782217026.730835:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217026.731104:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714087552 00000100:00100000:2.0:1782217026.731118:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714087552 00000100:00100000:2.0:1782217026.731179:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 222 00000100:00100000:2.0:1782217026.731190:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a802d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+63:11604:x1868789714087552:12345-192.168.203.19@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782217026.731311:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089fa4b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.731345:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089fa4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.731360:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089fa4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782217026.731650:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:2.0:1782217026.731766:0:5783:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004960b478 reply state 00000000d82b91d3 transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089fa4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217026.731776:0:5783:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782217026.731927:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a802d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+65:11604:x1868789714087552:12345-192.168.203.19@tcp:36:lhsmtool_posix.0 Request processed in 737us (1108us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1782217026.731935:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 222 00000100:00100000:0.0:1782217026.738305:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217026.738540:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714087680 00000100:00100000:3.0:1782217026.738554:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714087680 00000100:00100000:3.0:1782217026.738625:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 223 00000100:00100000:3.0:1782217026.738636:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+65:11604:x1868789714087680:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782217026.738665:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217026.738689:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089fa52 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6205d8 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.738764:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089fa52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205d8 expref: 66 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.738781:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089fa52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205d8 expref: 66 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.738802:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88e65417f200) 00010000:00010000:3.0:1782217026.738805:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782217026.738809:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e682171e00, rc 0) 00000100:00100000:3.0:1782217026.738914:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+66:11604:x1868789714087680:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 280us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217026.738922:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 223 00010000:00010000:2.0:1782217026.739032:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089fa4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.739043:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089fa4b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.739051:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089fa4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.739058:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738aec00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217026.739074:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089fa4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.739083:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089fa4b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.739098:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88e65417f200) 00010000:00010000:2.0:1782217026.739120:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782217026.739126:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089fa4b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.739132:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aec00/0xf210a9075089fa4b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217026.742216:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217026.742329:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714087808 00000100:00100000:3.0:1782217026.742342:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714087808 00000100:00100000:3.0:1782217026.742433:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 63 00000100:00100000:3.0:1782217026.742465:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a519450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+9:2358:x1868789714087808:12345-192.168.203.19@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1782217026.743459:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782217026.746098:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a519450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+10:2358:x1868789714087808:12345-192.168.203.19@tcp:2:lhsmtool_posix.0 Request processed in 3620us (3889us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1782217026.746116:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 63 00000100:00100000:1.0:1782217026.756988:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217026.758518:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714088064 00000100:00100000:2.0:1782217026.758538:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714088064 00000100:00100000:2.0:1782217026.758615:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 60 00000100:00100000:2.0:1782217026.758626:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+65:11604:x1868789714088064:12345-192.168.203.19@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1782217026.759158:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+66:11604:x1868789714088064:12345-192.168.203.19@tcp:35:lhsmtool_posix.0 Request processed in 531us (2182us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1782217026.759167:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 60 00000100:00100000:1.0:1782217026.762166:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217026.763165:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714088320 00000100:00100000:2.0:1782217026.763179:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714088320 00000100:00100000:2.0:1782217026.763379:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 224 00000100:00100000:2.0:1782217026.763392:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fff7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+66:11604:x1868789714088320:12345-192.168.203.19@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1782217026.763546:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fff7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+66:11604:x1868789714088320:12345-192.168.203.19@tcp:57:lhsmtool_posix.0 Request processed in 156us (1498us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217026.763554:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 224 00000100:00100000:1.0:1782217026.769845:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217026.770136:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714088448 00000100:00100000:3.0:1782217026.770149:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714088448 00000100:00100000:3.0:1782217026.770332:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 225 00000100:00100000:3.0:1782217026.770346:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fff5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+66:11604:x1868789714088448:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782217026.770372:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217026.770398:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089fa59 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6205df expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.770493:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171600/0xf210a9075089fa60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.770510:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171600/0xf210a9075089fa60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.770524:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171600/0xf210a9075089fa60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217026.770567:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782217026.770591:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171600/0xf210a9075089fa60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.770624:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089fa59 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205df expref: 68 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.770646:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171600/0xf210a9075089fa60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205df expref: 67 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.770656:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88e65417f200) 00010000:00010000:3.0:1782217026.770676:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1782217026.770680:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e682171600, rc 0) 00000100:00100000:3.0:1782217026.770769:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fff5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+67:11604:x1868789714088448:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 426us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217026.770776:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 225 00000100:00100000:1.0:1782217026.774030:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217026.774394:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714088576 00000100:00100000:3.0:1782217026.774407:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714088576 00000100:00100000:3.0:1782217026.774471:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 64 00000100:00100000:3.0:1782217026.774483:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+10:2359:x1868789714088576:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782217026.774509:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217026.774536:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009f30052/0xf210a9075089fa67 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6205e6 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782217026.774572:0:6579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3a7941, blocks: 0x1 00010000:00010000:3.0:1782217026.774596:0:6579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1782217026.774601:0:6579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217026.774612:0:6579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009f30052/0xf210a9075089fa67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205e6 expref: 11 pid: 6579 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.774633:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009f30052/0xf210a9075089fa67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205e6 expref: 11 pid: 6579 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.774649:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e682171200, rc 0) 00000100:00100000:3.0:1782217026.774734:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+11:2359:x1868789714088576:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 252us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217026.774742:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 64 00000100:00100000:1.0:1782217026.784659:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217026.784825:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714088832 00000100:00100000:0.0:1782217026.784838:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714088832 00000100:00100000:0.0:1782217026.784948:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 226 00000100:00100000:0.0:1782217026.784961:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+67:11604:x1868789714088832:12345-192.168.203.19@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1782217026.785110:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+67:11604:x1868789714088832:12345-192.168.203.19@tcp:57:lhsmtool_posix.0 Request processed in 150us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217026.785119:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 226 00000100:00100000:1.0:1782217026.790658:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217026.790763:0:11864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714088960 00000100:00100000:2.0:1782217026.790779:0:11864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714088960 00000100:00100000:2.0:1782217026.790848:0:11864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 65 00000100:00100000:2.0:1782217026.790861:0:11864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+11:11604:x1868789714088960:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782217026.790908:0:11864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217026.790935:0:11864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e725bbc1/0xf210a9075089fa6e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6205ed expref: -99 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.790993:0:11864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009f30052/0xf210a9075089fa67 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205e6 expref: 12 pid: 6579 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.791004:0:11864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217026.791009:0:11864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217026.791015:0:11864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e725bbc1/0xf210a9075089fa6e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205ed expref: 12 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.791070:0:11864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009f30052/0xf210a9075089fa67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205e6 expref: 12 pid: 6579 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.791088:0:11864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009f30052/0xf210a9075089fa67 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205e6 expref: 12 pid: 6579 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217026.791105:0:11864:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67fca3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11864:1868789733995008:192.168.203.19@tcp:104: 00000100:00100000:2.0:1782217026.791232:0:11864:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e647563600 going to sleep for 11 seconds 00000100:00100000:1.0:1782217026.798827:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217026.799180:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714089088 00000100:00100000:0.0:1782217026.799202:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714089088 00010000:00010000:0.0:1782217026.799266:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009f30052/0xf210a9075089fa67 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205e6 expref: 13 pid: 6579 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217026.799315:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 80 00000100:00100000:0.0:1782217026.799326:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648469f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+13:2358:x1868789714089088:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217026.799344:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217026.799375:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009f30052/0xf210a9075089fa67 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205e6 expref: 13 pid: 6579 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.799411:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009f30052/0xf210a9075089fa67 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205e6 expref: 13 pid: 6579 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.799444:0:5769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217026.799450:0:5769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217026.799461:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e725bbc1/0xf210a9075089fa6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205ed expref: 13 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.799474:0:5769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e725bbc1/0xf210a9075089fa6e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205ed expref: 13 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.799528:0:5769:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e725bbc1/0xf210a9075089fa6e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205ed expref: 13 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217026.799546:0:5769:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b97100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5769:1868789733995136:192.168.203.19@tcp:105: 00010000:00010000:2.0:1782217026.799769:0:11864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009f30052/0xf210a9075089fa67 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205e6 expref: 13 pid: 6579 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217026.799791:0:11864:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67fca3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11864:1868789733995008:192.168.203.19@tcp:104: 00010000:00010000:2.0:1782217026.799823:0:11864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e725bbc1/0xf210a9075089fa6e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205ed expref: 12 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.799834:0:11864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738aec00, rc 0) 00000100:00100000:0.0:1782217026.799947:0:5769:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6804ede40 going to sleep for 11 seconds 00000100:00100000:2.0:1782217026.801421:0:11864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+12:11604:x1868789714088960:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 10550us (10767us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217026.801437:0:11864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 65 00000100:00100000:0.0:1782217026.809779:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217026.810217:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714089216 00000100:00100000:1.0:1782217026.810238:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714089216 00002000:00100000:1.0:1782217026.810303:0:6585:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff88e649191c00 x1868789714089216/t0(0) o4->10ba4d21-74e8-42e8-8e52-48a327751cbd@192.168.203.19@tcp:277/0 lens 504/0 e 0 to 0 dl 1782217037 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782217026.810316:0:6585:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff88e649191c00 with x1868789714089216 ext(0->12) 00002000:00010000:1.0:1782217026.810322:0:6585:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88e649191c00 00000100:00100000:1.0:1782217026.810363:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 6 00000100:00100000:1.0:1782217026.810375:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649191c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+12:2357:x1868789714089216:12345-192.168.203.19@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1782217026.811099:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649191c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+14:2357:x1868789714089216:12345-192.168.203.19@tcp:4:lhsmtool_posix.0 Request processed in 721us (1330us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1782217026.811112:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 6 00002000:00100000:0.0:1782217026.811122:0:6585:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff88e649191c00 x1868789714089216/t4294967320(0) o4->10ba4d21-74e8-42e8-8e52-48a327751cbd@192.168.203.19@tcp:277/0 lens 504/448 e 0 to 0 dl 1782217037 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782217026.811131:0:6585:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff88e649191c00 with x1868789714089216 ext(0->12) 00002000:00010000:0.0:1782217026.811143:0:6585:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88e649191c00 00000100:00100000:2.0:1782217026.811699:0:5769:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b97100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5769:1868789733995136:192.168.203.19@tcp:105: 00010000:00010000:2.0:1782217026.811782:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217026.811818:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648469f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+13:2358:x1868789714089088:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 12494us (13007us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217026.811828:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 80 00000100:00100000:2.0:1782217026.824322:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217026.824382:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714089344 00000100:00100000:1.0:1782217026.824396:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714089344 00000100:00100000:1.0:1782217026.824476:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 227 00000100:00100000:1.0:1782217026.824490:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+67:11604:x1868789714089344:12345-192.168.203.19@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1782217026.884447:0:5805:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967503 is committed 00000004:00080000:2.0:1782217026.884540:0:5805:0:(osp_sync.c:1827:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:2.0:1782217026.884578:0:5805:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000004:00080000:2.0:1782217026.884603:0:5805:0:(osp_sync.c:1827:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1782217026.884632:0:5805:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88e647563e40 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1782217026.884638:0:5805:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff88e67fb4bf00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88e647563480 00000020:00080000:2.0:1782217026.884642:0:5805:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff88e67fb4b400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88e6740b2000 00000020:00080000:2.0:1782217026.884712:0:5805:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88e679faa300 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1782217026.884716:0:5805:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff88e67406f800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88e679faa900 00000020:00080000:2.0:1782217026.884719:0:5805:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff88e67406f300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88e6434d9000 00000020:00080000:2.0:1782217026.884733:0:5817:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1782217026.884984:0:5817:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1782217026.884995:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782217026.885021:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64846bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733995264:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782217026.885112:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217026.885419:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e649192a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733995392:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782217026.885448:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217026.885492:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733995264 00000100:00100000:0.0:1782217026.885499:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733995264 00000100:00100000:1.0:1782217026.885536:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733995392 00000100:00100000:1.0:1782217026.885541:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733995392 00000100:00100000:0.0:1782217026.885551:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782217026.885559:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fca0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1868789733995264:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782217026.885566:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1782217026.885571:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649190380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1868789733995392:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782217026.885592:0:6578:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00080000:0.0:1782217026.885592:0:6579:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:1.0:1782217026.885622:0:6578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076b26f34/0xf210a9075089fa75 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782217026.885628:0:6579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a3a7941, atime: 0x6a3a7941, ctime: 0x6a3a7941, blocks: 0x1 00010000:00010000:0.0:1782217026.885634:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064c4e269/0xf210a9075089fa7c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.885654:0:6579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=345s v=(0 0) 00010000:00010000:0.0:1782217026.885658:0:6579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217026.885660:0:6578:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cc741a3a/0xf210a9075089f837 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62054c expref: 12 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.885665:0:6579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064c4e269/0xf210a9075089fa7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.885668:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1782217026.885671:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782217026.885675:0:6578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076b26f34/0xf210a9075089fa75 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.885680:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064c4e269/0xf210a9075089fa7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.885692:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064c4e269/0xf210a9075089fa7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.885700:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064c4e269/0xf210a9075089fa7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.885702:0:6578:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cc741a3a/0xf210a9075089f837 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62054c expref: 12 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.885720:0:6579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782217026.885788:0:6578:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cc741a3a/0xf210a9075089f837 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62054c expref: 12 pid: 11864 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217026.885801:0:6578:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64846b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6578:1868789733995520:192.168.203.19@tcp:104: 00000100:00100000:1.0:1782217026.885869:0:6578:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e65002bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1782217026.887622:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fca0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3303:x1868789733995264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2053us (2501us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1782217026.887638:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:0.0:1782217026.887690:0:11515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782217026.887699:0:11515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064c4e269/0xf210a9075089fa7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.887713:0:11515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437ba00 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:0.0:1782217026.887719:0:11515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064c4e269/0xf210a9075089fa7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.887733:0:11515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064c4e269/0xf210a9075089fa7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.887756:0:11515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064c4e269/0xf210a9075089fa7c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.887764:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064c4e269/0xf210a9075089fa7c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.887790:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217026.887792:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217026.887794:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782217026.888449:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88e64846bb80/2, rc 0, transno 4294967310 00000100:00100000:2.0:1782217026.888475:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64846bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733995264:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782217026.888716:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+20:11604:x1868789714089344:12345-192.168.203.19@tcp:44:lhsmtool_posix.0 Request processed in 64226us (64405us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217026.888727:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 227 00000100:00100000:2.0:1782217026.891621:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217026.891807:0:6578:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64846b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6578:1868789733995520:192.168.203.19@tcp:104: 00010000:00010000:1.0:1782217026.891845:0:6578:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000076b26f34/0xf210a9075089fa75 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217026.892145:0:11864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714089472 00000100:00100000:3.0:1782217026.892153:0:11864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714089472 00000100:00100000:3.0:1782217026.892240:0:11864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 68 00000100:00100000:3.0:1782217026.892252:0:11864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+13:2359:x1868789714089472:12345-192.168.203.19@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1782217026.894285:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217026.894422:0:8300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714089600 00000100:00100000:3.0:1782217026.894433:0:8300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714089600 00010000:00010000:3.0:1782217026.894495:0:8300:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cc741a3a/0xf210a9075089f837 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62054c expref: 14 pid: 11864 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217026.894817:0:8300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 81 00000100:00100000:3.0:1782217026.894833:0:8300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64846b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+14:2358:x1868789714089600:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217026.894854:0:8300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217026.894863:0:8300:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cc741a3a/0xf210a9075089f837 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62054c expref: 14 pid: 11864 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.894910:0:8300:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cc741a3a/0xf210a9075089f837 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62054c expref: 14 pid: 11864 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.894940:0:8300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc741a3a/0xf210a9075089f837 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62054c expref: 14 pid: 11864 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.894961:0:8300:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782217026.894967:0:8300:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782217026.894993:0:8300:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000076b26f34/0xf210a9075089fa75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.895004:0:8300:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076b26f34/0xf210a9075089fa75 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.895046:0:8300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217026.895118:0:8300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64846b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+13:2358:x1868789714089600:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 289us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217026.895128:0:8300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 81 00010000:00010000:1.0:1782217026.895603:0:6578:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000076b26f34/0xf210a9075089fa75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.895631:0:6578:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076b26f34/0xf210a9075089fa75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.895643:0:6578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076b26f34/0xf210a9075089fa75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.895652:0:6578:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076b26f34/0xf210a9075089fa75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.895676:0:6578:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782217026.897458:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649190380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3301:x1868789733995392:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11874us (11996us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1782217026.897474:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:0.0:1782217026.897514:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88e649192a00/2, rc 0, transno 4294967321 00000100:00100000:0.0:1782217026.897529:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e649192a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733995392:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782217026.898215:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782217026.898237:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076b26f34/0xf210a9075089fa75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.898254:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07e00 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:2.0:1782217026.898259:0:5772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076b26f34/0xf210a9075089fa75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.898272:0:5772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076b26f34/0xf210a9075089fa75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.898298:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076b26f34/0xf210a9075089fa75 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.898306:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076b26f34/0xf210a9075089fa75 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.898334:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217026.898336:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217026.898337:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217026.932516:0:11864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:10ba4d21-74e8-42e8-8e52-48a327751cbd+12:2359:x1868789714089472:12345-192.168.203.19@tcp:16:lhsmtool_posix.0 Request processed in 40249us (40894us total) trans 0 rc 0/0 00000001:00080000:1.0:1782217026.932531:0:7488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:3.0:1782217026.932534:0:11864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 68 00000001:00080000:1.0:1782217026.932551:0:7488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:0.0:1782217026.942612:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217026.945307:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714089856 00000100:00100000:3.0:1782217026.945328:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714089856 00000100:00100000:3.0:1782217026.945481:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 228 00000100:00100000:3.0:1782217026.945494:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+20:11604:x1868789714089856:12345-192.168.203.19@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782217026.945570:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217026.946351:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171600/0xf210a9075089fa60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205df expref: 20 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.946379:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88e65417f200) 00010000:00010000:3.0:1782217026.946384:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782217026.946551:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089fa83 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.946567:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089fa83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.946599:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089fa83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782217026.949342:0:5785:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003a432143 reply state 00000000bbd46f09 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089fa83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217026.949367:0:5785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782217026.949633:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+21:11604:x1868789714089856:12345-192.168.203.19@tcp:36:lhsmtool_posix.0 Request processed in 4135us (7030us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1782217026.949645:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 228 00000100:00100000:2.0:1782217026.953235:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00010000:00010000:3.0:1782217026.953366:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089fa83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.953381:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089fa83 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.953390:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089fa83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.953397:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e682171000 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217026.953404:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089fa83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.953413:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089fa83 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.953967:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88e65417f200) 00010000:00010000:3.0:1782217026.953971:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217026.953978:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089fa83 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.954003:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089fa83 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217026.954087:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714089984 00000100:00100000:0.0:1782217026.954105:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714089984 00000100:00100000:0.0:1782217026.954180:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 69 00000100:00100000:0.0:1782217026.954192:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:2358:x1868789714089984:12345-192.168.203.19@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1782217026.954593:0:6579:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1782217026.954597:0:6579:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1782217025 00002000:00010000:0.0:1782217026.954600:0:6579:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1782217025 00002000:00010000:0.0:1782217026.954602:0:6579:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1782217025 -> 1782217025 00002000:00010000:0.0:1782217026.954604:0:6579:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1782217026.954684:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+8:2358:x1868789714089984:12345-192.168.203.19@tcp:2:lhsmtool_posix.0 Request processed in 493us (1474us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1782217026.954693:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 69 00000100:00100000:1.0:1782217026.956945:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217026.957316:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714090240 00000100:00100000:0.0:1782217026.957327:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714090240 00000100:00100000:0.0:1782217026.957426:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 229 00000100:00100000:0.0:1782217026.957438:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648469c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+20:11604:x1868789714090240:12345-192.168.203.19@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1782217026.957529:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089fa8a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.957551:0:6855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089fa44 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205d1 expref: 20 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.957561:0:6855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089fa8a lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.957607:0:6855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089fa44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205d1 expref: 20 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.957622:0:6855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089fa44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205d1 expref: 20 pid: 5784 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217026.957657:0:6855:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a0e2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6855:1868789733995648:192.168.203.19@tcp:104: 00000100:00100000:0.0:1782217026.957785:0:6855:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e67abf9540 going to sleep for 11 seconds 00000100:00100000:0.0:1782217026.960755:0:6855:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a0e2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6855:1868789733995648:192.168.203.19@tcp:104: 00000100:00100000:1.0:1782217026.960787:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00010000:00010000:0.0:1782217026.960790:0:6855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089fa8a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217026.960863:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714090368 00000100:00100000:3.0:1782217026.960872:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714090368 00010000:00010000:3.0:1782217026.960937:0:8299:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089fa44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205d1 expref: 21 pid: 5784 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217026.961018:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 82 00000100:00100000:3.0:1782217026.961030:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648468000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+21:2358:x1868789714090368:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217026.961049:0:8299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217026.961056:0:8299:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089fa44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205d1 expref: 21 pid: 5784 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.961069:0:8299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089fa44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205d1 expref: 21 pid: 5784 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.961145:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089fa44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205d1 expref: 21 pid: 5784 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.961165:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88e65417f200) 00010000:00010000:3.0:1782217026.961170:0:8299:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089fa8a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.961181:0:8299:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089fa8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.961190:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089fa8a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.961247:0:8299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217026.961309:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648468000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+20:2358:x1868789714090368:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 280us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217026.961319:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 82 00010000:00010000:0.0:1782217026.961358:0:6855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089fa8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.961367:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089fa8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.961403:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089fa8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.961410:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089fa8a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.961417:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089fa8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.961424:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437ba00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217026.961429:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089fa8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.961437:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089fa8a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.961446:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88e65417f200) 00010000:00010000:0.0:1782217026.961455:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1782217026.961461:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089fa8a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.961468:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a9075089fa8a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217026.961563:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648469c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+19:11604:x1868789714090240:12345-192.168.203.19@tcp:55:lhsmtool_posix.0 Request processed in 4126us (4630us total) trans 0 rc -22/-22 00000100:00100000:0.0:1782217026.961573:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 229 00000100:00100000:1.0:1782217026.966292:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217026.966383:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714090496 00000100:00100000:2.0:1782217026.966397:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714090496 00000100:00100000:2.0:1782217026.966501:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 70 00000100:00100000:2.0:1782217026.966514:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+8:2359:x1868789714090496:12345-192.168.203.19@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1782217026.966593:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000de9faacd/0xf210a9075089fa91 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.966618:0:7991:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e725bbc1/0xf210a9075089fa6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205ed expref: 8 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.966628:0:7991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1782217026.966632:0:7991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782217026.966638:0:7991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de9faacd/0xf210a9075089fa91 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.966678:0:7991:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e725bbc1/0xf210a9075089fa6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205ed expref: 8 pid: 11864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.966693:0:7991:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e725bbc1/0xf210a9075089fa6e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205ed expref: 8 pid: 11864 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217026.966709:0:7991:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7991:1868789733995776:192.168.203.19@tcp:104: 00000100:00100000:2.0:1782217026.966818:0:7991:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e647563d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782217026.969844:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217026.969872:0:7991:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7991:1868789733995776:192.168.203.19@tcp:104: 00010000:00010000:2.0:1782217026.969929:0:7991:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000de9faacd/0xf210a9075089fa91 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217026.969966:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714090624 00000100:00100000:0.0:1782217026.969975:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714090624 00010000:00010000:0.0:1782217026.970020:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e725bbc1/0xf210a9075089fa6e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205ed expref: 9 pid: 11864 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217026.970066:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 83 00000100:00100000:0.0:1782217026.970077:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652501f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+9:2358:x1868789714090624:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217026.970093:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217026.970120:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e725bbc1/0xf210a9075089fa6e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205ed expref: 9 pid: 11864 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.970134:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e725bbc1/0xf210a9075089fa6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205ed expref: 9 pid: 11864 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.970164:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e725bbc1/0xf210a9075089fa6e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205ed expref: 9 pid: 11864 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.970184:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782217026.970551:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782217026.970559:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000de9faacd/0xf210a9075089fa91 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.970570:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de9faacd/0xf210a9075089fa91 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.970607:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782217026.970783:0:7991:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000de9faacd/0xf210a9075089fa91 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.970808:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de9faacd/0xf210a9075089fa91 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.970840:0:7991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000de9faacd/0xf210a9075089fa91 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.970850:0:7991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de9faacd/0xf210a9075089fa91 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.970859:0:7991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de9faacd/0xf210a9075089fa91 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.970866:0:7991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738afa00 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:2.0:1782217026.970872:0:7991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de9faacd/0xf210a9075089fa91 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.970906:0:7991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de9faacd/0xf210a9075089fa91 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.970919:0:7991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de9faacd/0xf210a9075089fa91 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.970926:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de9faacd/0xf210a9075089fa91 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217026.971186:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+8:2359:x1868789714090496:12345-192.168.203.19@tcp:1:lhsmtool_posix.0 Request processed in 4671us (4905us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217026.971186:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652501f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+8:2358:x1868789714090624:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 1106us (1355us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217026.971197:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 70 00000100:00100000:0.0:1782217026.971197:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 83 00000100:00100000:3.0:1782217026.973427:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217026.973472:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714090880 00000100:00100000:2.0:1782217026.973486:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714090880 00000100:00100000:2.0:1782217026.973550:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 230 00000100:00100000:2.0:1782217026.973563:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67abcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+19:11604:x1868789714090880:12345-192.168.203.19@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1782217026.973678:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089fa98 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.973698:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089fa98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.973712:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089fa98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.974092:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089fa9f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.974107:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089fa52 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205d8 expref: 20 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.974117:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089fa9f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.974162:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089fa52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205d8 expref: 20 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.974213:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089fa52 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205d8 expref: 20 pid: 5784 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217026.974241:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b97100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5784:1868789733995904:192.168.203.19@tcp:104: 00000100:00100000:2.0:1782217026.974359:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e647563d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782217026.978834:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b97100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5784:1868789733995904:192.168.203.19@tcp:104: 00010000:00010000:2.0:1782217026.978904:0:5784:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089fa9f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217026.980002:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217026.980207:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714091008 00000100:00100000:0.0:1782217026.980227:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714091008 00010000:00010000:0.0:1782217026.980282:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089fa52 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205d8 expref: 21 pid: 5784 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217026.980330:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 84 00000100:00100000:0.0:1782217026.980341:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67abcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+21:2358:x1868789714091008:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217026.980363:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217026.980377:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089fa52 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205d8 expref: 21 pid: 5784 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.980390:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089fa52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205d8 expref: 21 pid: 5784 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.980482:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089fa52 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205d8 expref: 21 pid: 5784 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.980530:0:5768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88e65417f200) 00010000:00010000:0.0:1782217026.980536:0:5768:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089fa9f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.980547:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089fa9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.980555:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089fa9f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.980597:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217026.980669:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67abcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+20:2358:x1868789714091008:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 328us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217026.980679:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 84 00010000:00010000:2.0:1782217026.980814:0:5784:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089fa9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.980823:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089fa9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782217026.981122:0:5784:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1782217026.981306:0:5784:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:2.0:1782217026.981353:0:5784:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1782217026.981659:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b97100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5784:1868789733996032:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782217026.981733:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217026.981771:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e647563600 going to sleep for 11 seconds 00000100:00100000:3.0:1782217026.981802:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733996032 00000100:00100000:3.0:1782217026.981809:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733996032 00000100:00100000:3.0:1782217026.981867:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782217026.981892:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5784:x1868789733996032:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1782217026.981984:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5784:x1868789733996032:12345-0@lo:1000:mdt00_001.0 Request processed in 110us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217026.981992:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782217026.982295:0:5784:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:2.0:1782217026.982302:0:5784:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:2.0:1782217026.982325:0:5784:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88e649192a00, transno 4294967321 00000100:00100000:2.0:1782217026.982387:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b97100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5784:1868789733996032:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1782217026.983488:0:5784:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1782217026.983658:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648b97100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5784:1868789733996160:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782217026.983734:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217026.983816:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e647563d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782217026.983857:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733996160 00000100:00100000:3.0:1782217026.983866:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733996160 00000100:00100000:2.0:1782217026.984211:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782217026.984229:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5784:x1868789733996160:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782217026.984592:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5784:x1868789733996160:12345-0@lo:1000:mdt00_001.0 Request processed in 370us (856us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1782217026.984601:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782217026.984704:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648b97100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5784:1868789733996160:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1782217026.984751:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089fa9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.984764:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089fa9f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.984772:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089fa9f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.984780:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738af400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217026.984784:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089fa9f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.984805:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089fa9f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.984827:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88e65417f200) 00010000:00010000:3.0:1782217026.984830:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782217026.984836:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089fa9f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.984843:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089fa9f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.985031:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089f9e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.985039:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089f9e2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.985046:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089f9e2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.985051:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e682170400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217026.985055:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089f9e2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.985062:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089f9e2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.985072:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88e660936e00) 00010000:00010000:3.0:1782217026.985074:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782217026.985083:0:5784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f9e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205bc expref: 23 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.985107:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f9e9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205bc expref: 23 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.985117:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f9e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205bc expref: 23 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.985155:0:5784:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f9e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205bc expref: 23 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217026.985169:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67abcf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5784:1868789733996288:192.168.203.19@tcp:105: 00000100:00100000:3.0:1782217026.985325:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64153ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1782217026.990032:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217026.990195:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67abcf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5784:1868789733996288:192.168.203.19@tcp:105: 00010000:00010000:2.0:1782217026.990247:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089f9e2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.990260:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089f9e2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.990307:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089faa6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.990325:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089faa6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.990340:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089faa6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.990353:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089faa6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.990359:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089faa6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.990366:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089faa6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.990393:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738afa00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217026.990398:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089faa6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.990407:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089faa6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.990421:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88e660936e00) 00000100:00100000:1.0:1782217026.990423:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714091136 00010000:00010000:2.0:1782217026.990424:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217026.990428:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089faa6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217026.990431:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714091136 00010000:00010000:2.0:1782217026.990433:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738afa00/0xf210a9075089faa6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.990444:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089fa98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.990449:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089fa98 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.990454:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089fa98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.990458:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738af200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217026.990461:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089fa98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.990466:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089fa98 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.990482:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88e660936e00) 00010000:00010000:2.0:1782217026.990485:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782217026.990488:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089fa98 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217026.990494:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af200/0xf210a9075089fa98 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217026.990506:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 61 00000100:00100000:1.0:1782217026.990518:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67abcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+24:11602:x1868789714091136:12345-192.168.203.19@tcp:49:lfs.0 00000100:00100000:1.0:1782217026.990689:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67abcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+24:11602:x1868789714091136:12345-192.168.203.19@tcp:49:lfs.0 Request processed in 172us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217026.990707:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 61 00000040:00080000:2.0:1782217026.990845:0:11532:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782217026.990852:0:11532:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782217026.991738:0:11532:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:2.0:1782217026.991751:0:11532:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782217026.992110:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67abcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+23:11604:x1868789714090880:12345-192.168.203.19@tcp:57:lhsmtool_posix.0 Request processed in 18543us (18698us total) trans 4294967513 rc 0/0 00000100:00100000:2.0:1782217026.992124:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 230 00000020:00080000:2.0:1782217026.992131:0:5784:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1782217026.996385:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217026.996607:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714091392 00000100:00100000:2.0:1782217026.996621:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714091392 00000100:00100000:2.0:1782217026.996700:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 231 00000100:00100000:2.0:1782217026.996712:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67abcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+23:11602:x1868789714091392:12345-192.168.203.19@tcp:58:lfs.0 00000040:00080000:2.0:1782217026.997433:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1782217026.998410:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67abcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+23:11602:x1868789714091392:12345-192.168.203.19@tcp:58:lfs.0 Request processed in 1690us (2029us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217026.998426:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 231 00000100:00100000:3.0:1782217027.001491:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217027.001641:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714091648 00000100:00100000:1.0:1782217027.001653:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714091648 00000100:00100000:1.0:1782217027.001739:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 62 00000100:00100000:1.0:1782217027.001752:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664e8f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+23:11604:x1868789714091648:12345-192.168.203.19@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1782217027.003819:0:5787:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1782217027.003977:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:1.0:1782217027.004062:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089faad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.004082:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089faad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.004096:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089faad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.004107:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089faad lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.004113:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089faad lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.004119:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089faad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.004150:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782217027.004959:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664e8f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+25:11604:x1868789714091648:12345-192.168.203.19@tcp:35:lhsmtool_posix.0 Request processed in 3200us (3473us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1782217027.004975:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 62 00000100:00080000:0.0:1782217027.004996:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00080000:1.0:1782217027.004998:0:5787:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1782217027.005372:0:11514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782217027.005383:0:11514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089faad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.005405:0:11514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06400 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:2.0:1782217027.005411:0:11514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089faad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.005421:0:11514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089faad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.005439:0:11514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88e67a811900) 00010000:00010000:2.0:1782217027.005443:0:11514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782217027.005449:0:11514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089faad lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.005454:0:11514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06400/0xf210a9075089faad lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.005477:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217027.005479:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217027.005481:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217027.044370:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217027.044556:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714091776 00000100:00100000:3.0:1782217027.044569:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714091776 00000100:00100000:3.0:1782217027.044653:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 232 00000100:00100000:3.0:1782217027.044667:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a0e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+25:11606:x1868789714091776:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:3.0:1782217027.044698:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217027.044725:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089fab4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6205f4 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.044841:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171600/0xf210a9075089fabb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.044860:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171600/0xf210a9075089fabb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.044907:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171600/0xf210a9075089fabb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.044928:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089fac2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.044936:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089fac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.044943:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089fac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.045335:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089fac9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.045349:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171400/0xf210a9075089f9d4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205b5 expref: 26 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.045360:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089fac9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.045403:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171400/0xf210a9075089f9d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205b5 expref: 26 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.045419:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171400/0xf210a9075089f9d4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205b5 expref: 26 pid: 5785 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217027.045437:0:5785:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67abcc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1868789733996416:192.168.203.19@tcp:104: 00000100:00100000:3.0:1782217027.047816:0:5785:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64153ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1782217027.062208:0:5785:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67abcc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1868789733996416:192.168.203.19@tcp:104: 00010000:00010000:3.0:1782217027.062260:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089fac9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217027.062568:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217027.063090:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714092032 00000100:00100000:3.0:1782217027.063114:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714092032 00000100:00100000:3.0:1782217027.063188:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 63 00000100:00100000:3.0:1782217027.063200:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+27:5569:x1868789714092032:12345-192.168.203.19@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1782217027.063975:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+28:5569:x1868789714092032:12345-192.168.203.19@tcp:35:ldlm_bl.0 Request processed in 772us (1403us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1782217027.063986:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 63 00000100:00100000:2.0:1782217027.068211:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217027.069665:0:8301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714092160 00000100:00100000:1.0:1782217027.069685:0:8301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714092160 00010000:00010000:1.0:1782217027.069751:0:8301:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171400/0xf210a9075089f9d4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205b5 expref: 28 pid: 5785 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217027.073040:0:8301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 85 00000100:00100000:1.0:1782217027.073079:0:8301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f190a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:10ba4d21-74e8-42e8-8e52-48a327751cbd+28:2358:x1868789714092160:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782217027.073109:0:8301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217027.073123:0:8301:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171400/0xf210a9075089f9d4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205b5 expref: 28 pid: 5785 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.073144:0:8301:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171400/0xf210a9075089f9d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205b5 expref: 28 pid: 5785 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.073177:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171400/0xf210a9075089f9d4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205b5 expref: 28 pid: 5785 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.073202:0:8301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88e660936e00) 00010000:00010000:1.0:1782217027.073208:0:8301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089fac9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.073228:0:8301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089fac9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.073237:0:8301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089fac9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.073281:0:8301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782217027.073374:0:8301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f190a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:10ba4d21-74e8-42e8-8e52-48a327751cbd+27:2358:x1868789714092160:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 315us (5177us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217027.073518:0:8301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 85 00010000:00010000:0.0:1782217027.074529:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089fac9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.074544:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089fac9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217027.074609:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1782217027.074615:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782217027.074642:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089fac9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.074659:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089fac9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.074694:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171600/0xf210a9075089fabb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.074701:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171600/0xf210a9075089fabb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.074709:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171600/0xf210a9075089fabb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.074715:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e682171600 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217027.074721:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171600/0xf210a9075089fabb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.074729:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171600/0xf210a9075089fabb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.074746:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88e67a811000) 00010000:00010000:0.0:1782217027.074750:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217027.074755:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171600/0xf210a9075089fabb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.074762:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171600/0xf210a9075089fabb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.074780:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089fac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.074800:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089fac2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.074807:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089fac2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.074820:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e682170400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217027.074824:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089fac2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.074831:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089fac2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.074841:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88e660936c00) 00010000:00010000:0.0:1782217027.074844:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217027.074847:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089fac2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.074855:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089fac2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.074970:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089fab4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205f4 expref: 27 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.074987:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089fac9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205f4 expref: 26 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.074994:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88e660936e00) 00010000:00010000:0.0:1782217027.074997:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782217027.074999:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e682171e00, rc 0) 00000100:00100000:0.0:1782217027.075087:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a0e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+26:11606:x1868789714091776:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 30422us (30734us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217027.075097:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 232 00010000:00010000:2.0:1782217027.156134:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782217027.852600:0:12358:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782217027.852610:0:12358:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782217027.852676:0:12358:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 6 00000040:00080000:1.0:1782217027.852682:0:12358:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1782217028.056785:0:11532:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782217028.056795:0:11532:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782217028.056989:0:11532:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1782217028.056997:0:11532:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782217028.057110:0:11532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a805500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11532:1868789733996544:192.168.203.19@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1782217028.057203:0:11532:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e679faa780 going to sleep for 11 seconds 00000100:00100000:1.0:1782217028.064429:0:11532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a805500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11532:1868789733996544:192.168.203.19@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1782217028.069475:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217028.069527:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714092288 00000100:00100000:1.0:1782217028.069537:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714092288 00000100:00100000:1.0:1782217028.069587:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 233 00000100:00100000:1.0:1782217028.069597:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+26:11619:x1868789714092288:12345-192.168.203.19@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1782217028.069631:0:6855:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1782217028.069725:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+26:11619:x1868789714092288:12345-192.168.203.19@tcp:53:lhsmtool_posix.0 Request processed in 129us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217028.069733:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 233 00000100:00100000:2.0:1782217028.079339:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217028.079477:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714092544 00000100:00100000:1.0:1782217028.079486:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714092544 00000100:00100000:1.0:1782217028.079617:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 234 00000100:00100000:1.0:1782217028.079627:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f7a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+26:11619:x1868789714092544:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782217028.079659:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217028.079678:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089fad0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6205fb expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217028.079775:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089fad7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217028.079789:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089fad7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217028.079801:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089fad7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217028.079812:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1782217028.079959:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089fad0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205fb expref: 29 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217028.079977:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089fad7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205fb expref: 28 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217028.079986:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88e660936e00) 00010000:00010000:1.0:1782217028.079989:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782217028.079992:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd07400, rc 0) 00000100:00100000:1.0:1782217028.080043:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f7a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+28:11619:x1868789714092544:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 418us (712us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1782217028.080051:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 234 00000100:00100000:1.0:1782217028.090499:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217028.090547:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217028.090579:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714092672 00000100:00100000:2.0:1782217028.090590:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714092672 00000100:00100000:2.0:1782217028.090660:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 18 00000100:00100000:2.0:1782217028.090671:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e646ef2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+28:2359:x1868789714092672:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217028.090685:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217028.090709:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089fad7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205fb expref: 28 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.090739:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88e660936e00) 00010000:00010000:2.0:1782217028.090744:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217028.090795:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e646ef2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+27:2359:x1868789714092672:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 125us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217028.090802:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 18 00000100:00100000:3.0:1782217028.091428:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714092928 00000100:00100000:3.0:1782217028.091443:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714092928 00000100:00100000:3.0:1782217028.091518:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 235 00000100:00100000:3.0:1782217028.091532:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+27:11619:x1868789714092928:12345-192.168.203.19@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1782217028.091631:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171200/0xf210a9075089fae5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.091651:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171200/0xf210a9075089fae5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.091664:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171200/0xf210a9075089fae5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.092772:0:6855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171200/0xf210a9075089fae5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.092786:0:6855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171200/0xf210a9075089fae5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.092793:0:6855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171200/0xf210a9075089fae5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.092798:0:6855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e682171200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217028.092802:0:6855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171200/0xf210a9075089fae5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.092810:0:6855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171200/0xf210a9075089fae5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.092823:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88e660936e00) 00010000:00010000:2.0:1782217028.092826:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782217028.092829:0:6855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171200/0xf210a9075089fae5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.092836:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171200/0xf210a9075089fae5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217028.093045:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+28:11619:x1868789714092928:12345-192.168.203.19@tcp:57:lhsmtool_posix.0 Request processed in 1514us (2492us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1782217028.093061:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 235 00000040:00080000:0.0:1782217028.096825:0:11532:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782217028.096845:0:11532:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782217028.097374:0:11532:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1782217028.097383:0:11532:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782217028.100868:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217028.101044:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714093184 00000100:00100000:3.0:1782217028.101061:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714093184 00000100:00100000:3.0:1782217028.101318:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 64 00000100:00100000:3.0:1782217028.101330:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+28:11619:x1868789714093184:12345-192.168.203.19@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1782217028.101674:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+29:11619:x1868789714093184:12345-192.168.203.19@tcp:35:lhsmtool_posix.0 Request processed in 345us (813us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1782217028.101684:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 64 00010000:00010000:0.0:1782217028.180107:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217028.564216:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f7a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733996672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782217028.564329:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217028.565633:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733996672 00000100:00100000:1.0:1782217028.565650:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733996672 00000100:00080000:2.0:1782217028.565726:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782217028.565737:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1782217028.565748:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a0e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1868789733996672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782217028.565794:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782217028.565903:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a0e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1868789733996672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (1574us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217028.565911:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1782217028.567280:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f7a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733996672:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1782217028.633675:0:6609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1782217028.633698:0:6609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00010000:00010000:2.0:1782217029.206511:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217029.627914:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217029.627950:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217029.627982:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217029.628007:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217029.628032:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217029.628058:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714093312 00000100:00100000:3.0:1782217029.628066:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714093312 00000100:00100000:3.0:1782217029.628124:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 295 00000100:00100000:3.0:1782217029.628135:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2357:x1868789714093312:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:3.0:1782217029.628211:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2357:x1868789714093312:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 78us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217029.628219:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 295 00000100:00100000:3.0:1782217029.628252:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714093696 00000100:00100000:3.0:1782217029.628255:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714093696 00000100:00100000:3.0:1782217029.628283:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714093568 00000100:00100000:3.0:1782217029.628286:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714093568 00000100:00100000:3.0:1782217029.628308:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 91 00000100:00100000:3.0:1782217029.628314:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67abce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:2357:x1868789714093696:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:3.0:1782217029.628343:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67abce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:2357:x1868789714093696:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 29us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217029.628349:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 91 00000100:00100000:3.0:1782217029.628374:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 92 00000100:00100000:3.0:1782217029.628382:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67abcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2357:x1868789714093568:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:3.0:1782217029.628408:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67abcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2357:x1868789714093568:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 27us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217029.628414:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 92 00000100:00100000:2.0:1782217029.628798:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714093440 00000100:00100000:2.0:1782217029.628804:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714093440 00000100:00100000:2.0:1782217029.628834:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714093824 00000100:00100000:2.0:1782217029.628837:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714093824 00000100:00100000:2.0:1782217029.628860:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 152 00000100:00100000:2.0:1782217029.628867:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67abcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+29:2357:x1868789714093440:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:2.0:1782217029.628922:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67abcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+29:2357:x1868789714093440:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 54us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217029.628929:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 152 00000100:00100000:2.0:1782217029.628943:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 153 00000100:00100000:2.0:1782217029.628949:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67abcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2357:x1868789714093824:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:2.0:1782217029.628973:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67abcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2357:x1868789714093824:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 24us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217029.628980:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 153 00000100:00080000:2.0:1782217029.628995:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782217029.628999:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782217029.629001:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1782217029.661811:0:12410:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782217029.661821:0:12410:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782217029.661869:0:12410:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1782217029.663980:0:12410:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782217029.852824:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217029.853309:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714094080 00000100:00100000:3.0:1782217029.853320:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714094080 00000100:00100000:3.0:1782217029.853416:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 236 00000100:00100000:3.0:1782217029.853428:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649192a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+29:11639:x1868789714094080:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:3.0:1782217029.853448:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217029.853470:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171400/0xf210a9075089faec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620602 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.853572:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089faf3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.853586:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089faf3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.853598:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089faf3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217029.853609:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1782217029.853733:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171400/0xf210a9075089faec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620602 expref: 32 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.853753:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089faf3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620602 expref: 31 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.853777:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88e660936e00) 00010000:00010000:3.0:1782217029.853780:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1782217029.853783:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e682171000, rc 0) 00000100:00100000:3.0:1782217029.853850:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649192a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+31:11639:x1868789714094080:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 424us (1035us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1782217029.853857:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 236 00000100:00100000:3.0:1782217029.860953:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217029.861183:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714094208 00000100:00100000:3.0:1782217029.861192:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714094208 00000100:00100000:3.0:1782217029.861253:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 237 00000100:00100000:3.0:1782217029.861262:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67abcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+31:11639:x1868789714094208:12345-192.168.203.19@tcp:54:lfs.0 00010000:00010000:3.0:1782217029.861324:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089fb01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.861341:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089fb01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.861352:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089fb01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.861381:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089fb01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.861387:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089fb01 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.861394:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089fb01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.861411:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e682170400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217029.861416:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089fb01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.861423:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089fb01 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.861435:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88e660936e00) 00010000:00010000:3.0:1782217029.861438:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782217029.861442:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089fb01 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.861448:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170400/0xf210a9075089fb01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217029.861529:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67abcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+31:11639:x1868789714094208:12345-192.168.203.19@tcp:54:lfs.0 Request processed in 267us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217029.861536:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 237 00000100:00100000:2.0:1782217029.972042:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217029.974184:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714094336 00000100:00100000:1.0:1782217029.974207:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714094336 00000100:00100000:1.0:1782217029.974337:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 71 00000100:00100000:1.0:1782217029.974348:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f7a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:2357:x1868789714094336:12345-192.168.203.19@tcp:101:cat.0 00010000:00010000:1.0:1782217029.974366:0:7991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217029.974387:0:7991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069c90b12/0xf210a9075089fb08 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620609 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782217029.974414:0:7991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a3a7941, atime: 0x6a3a7941, ctime: 0x6a3a7941, blocks: 0xb 00010000:00010000:1.0:1782217029.974432:0:7991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=349s v=(0 0) 00010000:00010000:1.0:1782217029.974437:0:7991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217029.974446:0:7991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069c90b12/0xf210a9075089fb08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620609 expref: 8 pid: 7991 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.974477:0:7991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000069c90b12/0xf210a9075089fb08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620609 expref: 8 pid: 7991 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.974490:0:7991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd06200, rc 0) 00000100:00100000:1.0:1782217029.974571:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f7a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+8:2357:x1868789714094336:12345-192.168.203.19@tcp:101:cat.0 Request processed in 224us (2538us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217029.974578:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 71 00000100:00100000:3.0:1782217029.985716:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217029.985935:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714094464 00000100:00100000:0.0:1782217029.985951:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714094464 00002000:00100000:0.0:1782217029.986023:0:6584:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff88e67abcf100 x1868789714094464/t0(0) o3->10ba4d21-74e8-42e8-8e52-48a327751cbd@192.168.203.19@tcp:280/0 lens 488/0 e 0 to 0 dl 1782217040 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782217029.986035:0:6584:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff88e67abcf100 with x1868789714094464 ext(0->4095) 00002000:00010000:0.0:1782217029.986042:0:6584:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88e67abcf100 00000100:00100000:0.0:1782217029.986081:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 7 00000100:00100000:0.0:1782217029.986093:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67abcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+8:2359:x1868789714094464:12345-192.168.203.19@tcp:3:cat.0 00000100:00100000:0.0:1782217029.986393:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67abcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+8:2359:x1868789714094464:12345-192.168.203.19@tcp:3:cat.0 Request processed in 301us (703us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1782217029.986403:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 7 00002000:00100000:0.0:1782217029.986411:0:6584:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff88e67abcf100 x1868789714094464/t0(0) o3->10ba4d21-74e8-42e8-8e52-48a327751cbd@192.168.203.19@tcp:280/0 lens 488/4536 e 0 to 0 dl 1782217040 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782217029.986420:0:6584:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff88e67abcf100 with x1868789714094464 ext(0->4095) 00002000:00010000:0.0:1782217029.986424:0:6584:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88e67abcf100 00010000:00010000:2.0:1782217030.230156:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782217030.612744:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f758700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789733996800:0@lo:400:kworker.0 00000100:00100000:2.0:1782217030.612847:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217030.612936:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6508d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1868789733997312:0@lo:400:kworker.0 00000100:00100000:3.0:1782217030.612942:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f759500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1868789733997184:0@lo:400:kworker.0 00000100:00100000:2.0:1782217030.612968:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217030.613000:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217030.613004:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782217030.613010:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f75aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868789733996928:0@lo:400:kworker.0 00000100:00100000:3.0:1782217030.613018:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782217030.613024:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f75ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733997056:0@lo:400:kworker.0 00000100:00100000:2.0:1782217030.613045:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217030.613048:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217030.613076:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733997312 00000100:00100000:3.0:1782217030.613086:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733997312 00000100:00100000:3.0:1782217030.613151:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733997184 00000100:00100000:3.0:1782217030.613154:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733997184 00000100:00100000:3.0:1782217030.613179:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733996928 00000100:00100000:3.0:1782217030.613182:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733996928 00000100:00100000:3.0:1782217030.613210:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1782217030.613219:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f7a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1868789733997312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217030.613281:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f7a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1868789733997312:12345-0@lo:400:kworker.0 Request processed in 62us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217030.613289:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1782217030.613307:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1782217030.613313:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1868789733997184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217030.613406:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6508da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733997440:0@lo:400:kworker.0 00000100:00100000:3.0:1782217030.613421:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1868789733997184:12345-0@lo:400:kworker.0 Request processed in 32us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217030.613429:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1782217030.613434:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217030.613442:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1782217030.613448:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f7a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868789733996928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217030.613474:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f7a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868789733996928:12345-0@lo:400:kworker.0 Request processed in 27us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217030.613474:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6508d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1868789733997312:0@lo:400:kworker.0 00000100:00100000:3.0:1782217030.613480:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1782217030.613501:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733997056 00000100:00100000:3.0:1782217030.613504:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733997056 00000100:00100000:2.0:1782217030.613512:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f75aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868789733996928:0@lo:400:kworker.0 00000100:00100000:3.0:1782217030.613531:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733997440 00000100:00100000:3.0:1782217030.613533:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733997440 00000100:00080000:2.0:1782217030.613549:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782217030.613553:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782217030.613554:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00080000:2.0:1782217030.613557:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782217030.613560:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733997056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217030.613570:0:11864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1782217030.613577:0:11864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648469f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3303:x1868789733997440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217030.613591:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733997056:12345-0@lo:400:kworker.0 Request processed in 31us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217030.613610:0:11864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648469f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3303:x1868789733997440:12345-0@lo:400:kworker.0 Request processed in 34us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217030.613616:0:11864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1782217030.613649:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6508da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733997440:0@lo:400:kworker.0 00000100:00100000:2.0:1782217030.613686:0:3302:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1782217030.613692:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1782217030.613710:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88e64846bb80, transno 4294967310 00000100:00100000:2.0:1782217030.613721:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f75ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733997056:0@lo:400:kworker.0 00000100:00100000:3.0:1782217030.613732:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1782217030.613733:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f759500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1868789733997184:0@lo:400:kworker.0 00000100:00100000:1.0:1782217030.614182:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733996800 00000100:00100000:1.0:1782217030.614189:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733996800 00000100:00100000:1.0:1782217030.614245:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1782217030.614254:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+19:3303:x1868789733996800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217030.614310:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:526a4802-b871-4bcf-870f-067f11655366+19:3303:x1868789733996800:12345-0@lo:400:kworker.0 Request processed in 57us (1463us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217030.614317:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1782217030.614637:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f758700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789733996800:0@lo:400:kworker.0 00000004:00080000:0.0:1782217031.125410:0:7777:0:(osp_sync.c:1862:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 350177529052ns, next at 351177525627ns, rc = 0 00000100:00100000:0.0:1782217031.125450:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782217031.125479:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a0e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733997568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782217031.125571:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217031.125652:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733997568 00000100:00100000:0.0:1782217031.125660:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733997568 00000100:00100000:1.0:1782217031.126412:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1782217031.126431:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a0e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1868789733997568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782217031.126482:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782217031.126557:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a0e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1868789733997568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217031.126565:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1782217031.126638:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a0e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733997568:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782217031.253510:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782217032.217051:0:7488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:3.0:1782217032.217075:0:7488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000004:00080000:2.0:1782217032.220500:0:5805:0:(osp_sync.c:1827:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000001:00080000:2.0:1782217032.220532:0:5805:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000020:00080000:2.0:1782217032.220565:0:5805:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88e647563600 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1782217032.220569:0:5805:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff88e67fb4b900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88e647563cc0 00000020:00080000:2.0:1782217032.220573:0:5805:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff88e67fb4b800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88e6740b1800 00000020:00080000:2.0:1782217032.220598:0:5805:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:2.0:1782217032.220604:0:5805:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1782217032.220623:0:5817:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1782217032.220814:0:5817:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:2.0:1782217032.221017:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a0e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733997696:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1782217032.221083:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217032.221193:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733997696 00000100:00100000:0.0:1782217032.221201:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733997696 00000100:00100000:0.0:1782217032.221257:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1782217032.221331:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64846b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733997696:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1782217032.221513:0:7991:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1782217032.221517:0:7991:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1782217025 -> 1782217025 00002000:00010000:0.0:1782217032.221520:0:7991:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1782217025 -> 1782217025 00002000:00010000:0.0:1782217032.221522:0:7991:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1782217025 -> 1782217025 00002000:00010000:0.0:1782217032.221525:0:7991:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1782217032.221565:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64846b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3302:x1868789733997696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 299us (481us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1782217032.221572:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1782217032.221630:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782217032.221661:0:3302:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:2.0:1782217032.221666:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967323 00000100:00100000:2.0:1782217032.221748:0:3302:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff88e67a0e3800 x1868789733997696/t4294967324(4294967324) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1782217048 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1782217032.221759:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88e67a0e3800/2, rc 0, transno 4294967324 00000100:00100000:2.0:1782217032.221764:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a0e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733997696:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1782217032.276089:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217033.304432:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217033.684277:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782217033.688805:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e648468000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733997824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782217033.688873:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217033.691316:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733997824 00000100:00100000:1.0:1782217033.691331:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733997824 00000100:00100000:1.0:1782217033.691420:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1782217033.691431:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a0e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733997824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782217033.691469:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782217033.691552:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a0e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733997824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (2677us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217033.691577:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1782217033.691858:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782217033.699921:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e648468000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733997824:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782217034.331234:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782217034.752808:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217034.752843:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217034.752870:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217034.752921:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217034.752946:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217034.752972:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714094848 00000100:00100000:1.0:1782217034.752982:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714094848 00000100:00100000:1.0:1782217034.753034:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714094976 00000100:00100000:1.0:1782217034.753037:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714094976 00000100:00100000:1.0:1782217034.753059:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 95 00000100:00100000:1.0:1782217034.753067:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2359:x1868789714094848:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:1.0:1782217034.753127:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2359:x1868789714094848:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 60us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217034.753134:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 95 00000100:00100000:1.0:1782217034.753149:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 96 00000100:00100000:1.0:1782217034.753154:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6454aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:2359:x1868789714094976:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:1.0:1782217034.753187:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6454aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:2359:x1868789714094976:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 33us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217034.753194:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 96 00000100:00100000:1.0:1782217034.753210:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714095104 00000100:00100000:1.0:1782217034.753213:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714095104 00000100:00100000:1.0:1782217034.753235:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714094720 00000100:00100000:1.0:1782217034.753238:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714094720 00000100:00100000:1.0:1782217034.753255:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 157 00000100:00100000:1.0:1782217034.753260:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e652483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2359:x1868789714095104:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:1.0:1782217034.753296:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e652483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2359:x1868789714095104:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 36us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217034.753301:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 157 00000100:00100000:1.0:1782217034.753312:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 158 00000100:00100000:1.0:1782217034.753317:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6454a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+18:2359:x1868789714094720:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:1.0:1782217034.753335:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6454a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+18:2359:x1868789714094720:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 18us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217034.753340:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 158 00000100:00080000:1.0:1782217034.753353:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782217034.753356:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782217034.753358:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782217034.755328:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714094592 00000100:00100000:3.0:1782217034.755340:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714094592 00000100:00100000:3.0:1782217034.755395:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 297 00000100:00100000:3.0:1782217034.755403:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2359:x1868789714094592:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:3.0:1782217034.755456:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2359:x1868789714094592:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 54us (2659us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217034.755463:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 297 00000100:00100000:3.0:1782217035.180973:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217035.181073:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714095232 00000100:00100000:1.0:1782217035.181084:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714095232 00000100:00100000:1.0:1782217035.181145:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 238 00000100:00100000:1.0:1782217035.181156:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+18:11291:x1868789714095232:12345-192.168.203.19@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1782217035.181289:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+18:11291:x1868789714095232:12345-192.168.203.19@tcp:60:lhsmtool_posix.0 Request processed in 133us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217035.181297:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 238 00000100:00100000:3.0:1782217035.183308:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217035.183448:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714095488 00000100:00100000:1.0:1782217035.183457:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714095488 00000100:00100000:1.0:1782217035.183512:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 65 00000100:00100000:1.0:1782217035.183524:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+18:11291:x1868789714095488:12345-192.168.203.19@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1782217035.184058:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+19:11291:x1868789714095488:12345-192.168.203.19@tcp:35:lhsmtool_posix.0 Request processed in 533us (756us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1782217035.184067:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 65 00010000:00010000:2.0:1782217035.348296:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217035.503052:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217035.503180:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714095616 00000100:00100000:1.0:1782217035.503189:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714095616 00000100:00100000:1.0:1782217035.503315:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 239 00000100:00100000:1.0:1782217035.503325:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:12090:x1868789714095616:12345-192.168.203.19@tcp:101:lsof.0 00010000:00010000:1.0:1782217035.503344:0:6855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217035.503364:0:6855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089fb0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620610 expref: -99 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217035.503429:0:6855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089fb16 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217035.503443:0:6855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089fb16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217035.503454:0:6855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089fb16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217035.503644:0:6855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782217035.503648:0:6855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1782217035.503730:0:6855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089fb16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217035.503827:0:6855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07400/0xf210a9075089fb0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620610 expref: 7 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217035.503846:0:6855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089fb16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620610 expref: 6 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217035.503854:0:6855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e650a64300) 00010000:00010000:1.0:1782217035.503857:0:6855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782217035.503867:0:6855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67fd06c00, rc 0) 00000100:00100000:1.0:1782217035.504534:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+6:12090:x1868789714095616:12345-192.168.203.19@tcp:101:lsof.0 Request processed in 1207us (1489us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217035.504543:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 239 00000100:00100000:1.0:1782217035.732917:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f189c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1868789733998336:0@lo:400:kworker.0 00000100:00100000:1.0:1782217035.732983:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217035.733044:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1782217035.733056:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f18b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789733997952:0@lo:400:kworker.0 00000100:00100000:1.0:1782217035.733085:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217035.733108:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f188000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1868789733998464:0@lo:400:kworker.0 00000100:00100000:1.0:1782217035.733133:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217035.733171:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733997952 00000100:00100000:1.0:1782217035.733178:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733997952 00000100:00100000:1.0:1782217035.733216:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1782217035.733224:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6524b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+19:3303:x1868789733997952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217035.733271:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6524b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+19:3303:x1868789733997952:12345-0@lo:400:kworker.0 Request processed in 48us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217035.733278:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1782217035.733313:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733998336 00000100:00100000:1.0:1782217035.733317:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733998336 00000100:00100000:1.0:1782217035.733346:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733998464 00000100:00100000:1.0:1782217035.733349:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733998464 00000100:00100000:1.0:1782217035.733367:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1782217035.733373:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6454a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868789733998336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217035.733405:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6454a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868789733998336:12345-0@lo:400:kworker.0 Request processed in 32us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217035.733411:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1782217035.733435:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1782217035.733441:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1868789733998464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217035.733469:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1868789733998464:12345-0@lo:400:kworker.0 Request processed in 29us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217035.733475:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:1.0:1782217035.733490:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782217035.733525:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f18b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789733997952:0@lo:400:kworker.0 00000100:00100000:1.0:1782217035.733537:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f188000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1868789733998464:0@lo:400:kworker.0 00000100:00100000:1.0:1782217035.733547:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f189c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1868789733998336:0@lo:400:kworker.0 00000100:00100000:2.0:1782217035.733912:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f18a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733998208:0@lo:400:kworker.0 00000100:00100000:2.0:1782217035.733948:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217035.733979:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1782217035.733985:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1868789733998080:0@lo:400:kworker.0 00000100:00100000:2.0:1782217035.734005:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217035.734030:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67fcb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733998592:0@lo:400:kworker.0 00000100:00100000:2.0:1782217035.734049:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217035.734073:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733998208 00000100:00100000:2.0:1782217035.734078:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733998208 00000100:00100000:2.0:1782217035.734108:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733998592 00000100:00100000:2.0:1782217035.734111:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733998592 00000100:00100000:2.0:1782217035.734128:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1782217035.734134:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648468000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733998208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217035.734181:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648468000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789733998208:12345-0@lo:400:kworker.0 Request processed in 47us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217035.734187:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1782217035.734199:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1782217035.734204:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e648b97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1868789733998592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217035.734231:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e648b97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1868789733998592:12345-0@lo:400:kworker.0 Request processed in 27us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217035.734236:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:2.0:1782217035.734249:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782217035.734251:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782217035.734269:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67fcb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733998592:0@lo:400:kworker.0 00000100:00100000:2.0:1782217035.734277:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f18a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789733998208:0@lo:400:kworker.0 00000100:00100000:2.0:1782217035.734294:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733998080 00000100:00100000:2.0:1782217035.734297:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733998080 00000100:00100000:2.0:1782217035.734317:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1782217035.734322:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64846bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1868789733998080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217035.734351:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64846bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1868789733998080:12345-0@lo:400:kworker.0 Request processed in 29us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217035.734356:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1782217035.734386:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1868789733998080:0@lo:400:kworker.0 00000100:00100000:3.0:1782217036.245522:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782217036.245545:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67fcb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733998720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782217036.245626:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217036.245741:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733998720 00000100:00100000:1.0:1782217036.245748:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733998720 00000100:00100000:1.0:1782217036.245805:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782217036.245814:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1868789733998720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782217036.245848:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782217036.245916:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1868789733998720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217036.245923:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1782217036.246187:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67fcb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733998720:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782217036.373032:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782217037.306621:0:7488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:0.0:1782217037.309065:0:5805:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:0.0:1782217037.309089:0:5805:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1782217037.309168:0:5817:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1782217037.309179:0:5817:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1782217037.399435:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782217038.356268:0:11532:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782217038.356281:0:11532:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782217038.357989:0:11532:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:1.0:1782217038.358004:0:11532:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1782217038.421167:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782217038.804092:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67fcb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733998848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782217038.804195:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217038.804339:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733998848 00000100:00100000:1.0:1782217038.804349:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733998848 00000100:00100000:1.0:1782217038.804428:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1782217038.804440:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733998848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782217038.804496:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782217038.804548:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789733998848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217038.804555:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1782217038.804580:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782217038.804586:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67fcb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789733998848:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1782217038.995598:0:12611:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 08:17:16 (1782217036) 00010000:00010000:2.0:1782217039.444112:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217039.872375:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217039.872415:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217039.872443:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217039.872464:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217039.872486:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217039.872515:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714096128 00000100:00100000:3.0:1782217039.872524:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714096128 00000100:00100000:3.0:1782217039.872572:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714096000 00000100:00100000:3.0:1782217039.872576:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714096000 00000100:00100000:3.0:1782217039.872600:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 99 00000100:00100000:3.0:1782217039.872610:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:2357:x1868789714096128:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:3.0:1782217039.872679:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:2357:x1868789714096128:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 71us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217039.872692:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 99 00000100:00100000:3.0:1782217039.872709:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 100 00000100:00100000:3.0:1782217039.872716:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2357:x1868789714096000:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:3.0:1782217039.873322:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2357:x1868789714096000:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 604us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217039.873330:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 100 00000100:00100000:3.0:1782217039.873353:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714095744 00000100:00100000:3.0:1782217039.873359:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714095744 00000100:00100000:3.0:1782217039.873384:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 299 00000100:00080000:1.0:1782217039.873389:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782217039.873390:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2357:x1868789714095744:12345-192.168.203.19@tcp:400:kworker.0 00000100:00080000:1.0:1782217039.873393:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782217039.873414:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2357:x1868789714095744:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 25us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217039.873421:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 299 00000100:00100000:3.0:1782217039.874048:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714095872 00000100:00100000:3.0:1782217039.874055:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714095872 00000100:00100000:3.0:1782217039.874096:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714096256 00000100:00100000:3.0:1782217039.874100:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714096256 00000100:00100000:3.0:1782217039.874131:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 162 00000100:00100000:3.0:1782217039.874139:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+18:2357:x1868789714095872:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:3.0:1782217039.874189:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+18:2357:x1868789714095872:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 51us (1822us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217039.874196:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 162 00000100:00100000:3.0:1782217039.874208:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 163 00000100:00100000:3.0:1782217039.874215:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+6:2357:x1868789714096256:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:3.0:1782217039.874249:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+6:2357:x1868789714096256:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 35us (1762us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217039.874257:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 163 00000100:00080000:1.0:1782217039.875897:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782217040.470219:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217040.852778:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67fca0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733998976:0@lo:400:kworker.0 00000100:00100000:3.0:1782217040.853351:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217040.853468:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733998976 00000100:00100000:0.0:1782217040.853479:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733998976 00000100:00100000:0.0:1782217040.853543:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1782217040.853554:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+19:3304:x1868789733998976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217040.853818:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:526a4802-b871-4bcf-870f-067f11655366+19:3304:x1868789733998976:12345-0@lo:400:kworker.0 Request processed in 265us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217040.853827:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1782217040.854039:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f758700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789733999104:0@lo:400:kworker.0 00000100:00100000:2.0:1782217040.854081:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217040.854112:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e652501f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733999616:0@lo:400:kworker.0 00000100:00100000:2.0:1782217040.854150:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217040.854176:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782217040.854181:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f759500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733999232:0@lo:400:kworker.0 00000100:00100000:2.0:1782217040.854203:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217040.854235:0:11864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733999616 00000100:00100000:2.0:1782217040.854240:0:11864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733999616 00000100:00100000:2.0:1782217040.854293:0:11864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733999232 00000100:00100000:2.0:1782217040.854296:0:11864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733999232 00000100:00100000:2.0:1782217040.854324:0:11864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1782217040.854332:0:11864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e646105180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733999616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217040.854375:0:11864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e646105180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733999616:12345-0@lo:400:kworker.0 Request processed in 44us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217040.854381:0:11864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1782217040.854395:0:11864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1782217040.854401:0:11864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e646105f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733999232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217040.854428:0:11864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e646105f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733999232:12345-0@lo:400:kworker.0 Request processed in 28us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217040.854434:0:11864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:2.0:1782217040.854451:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782217040.854456:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782217040.854496:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f759500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733999232:0@lo:400:kworker.0 00000100:00100000:2.0:1782217040.854507:0:3301:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1782217040.854514:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88e67a0e3800, transno 4294967324 00000100:00100000:2.0:1782217040.854527:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e652501f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733999616:0@lo:400:kworker.0 00000100:00100000:0.0:1782217040.856234:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733999104 00000100:00100000:0.0:1782217040.856248:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733999104 00000100:00100000:0.0:1782217040.856316:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1782217040.856327:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789733999104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217040.856427:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789733999104:12345-0@lo:400:kworker.0 Request processed in 102us (2344us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217040.856436:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1782217040.857159:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f758700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789733999104:0@lo:400:kworker.0 00000100:00100000:3.0:1782217040.857259:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67fca0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789733998976:0@lo:400:kworker.0 00000100:00100000:3.0:1782217040.857509:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f75aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1868789733999488:0@lo:400:kworker.0 00000100:00100000:3.0:1782217040.857564:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217040.857649:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782217040.857659:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f75ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1868789733999360:0@lo:400:kworker.0 00000100:00100000:3.0:1782217040.857687:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217040.859348:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733999488 00000100:00100000:0.0:1782217040.859363:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733999488 00000100:00100000:3.0:1782217040.859483:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733999360 00000100:00100000:3.0:1782217040.859488:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733999360 00000100:00100000:3.0:1782217040.859612:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1782217040.859744:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868789733999360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217040.859861:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868789733999360:12345-0@lo:400:kworker.0 Request processed in 124us (2171us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217040.859870:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1782217040.860047:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f75ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1868789733999360:0@lo:400:kworker.0 00000100:00080000:0.0:1782217040.860331:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782217040.861067:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1782217040.861080:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868789733999488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217040.861187:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868789733999488:12345-0@lo:400:kworker.0 Request processed in 109us (3621us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217040.861194:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1782217040.861244:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f75aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1868789733999488:0@lo:400:kworker.0 00000100:00080000:0.0:1782217040.861549:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782217041.364224:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782217041.364266:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67fcb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733999744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782217041.364362:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217041.368208:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733999744 00000100:00100000:1.0:1782217041.368229:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733999744 00000100:00100000:1.0:1782217041.368321:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1782217041.368334:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fca0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733999744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782217041.368401:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782217041.368537:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fca0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789733999744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 197us (4166us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217041.368545:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1782217041.368602:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67fcb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789733999744:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782217041.492352:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217042.240794:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217042.240871:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714096512 00000100:00100000:2.0:1782217042.240921:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714096512 00000100:00100000:2.0:1782217042.241013:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 66 00000100:00100000:2.0:1782217042.241028:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+18:12311:x1868789714096512:12345-192.168.203.19@tcp:35:umount.0 00000100:00100000:2.0:1782217042.241750:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+19:12311:x1868789714096512:12345-192.168.203.19@tcp:35:umount.0 Request processed in 721us (966us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1782217042.241762:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 66 00000100:00080000:0.0:1782217042.241874:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782217042.244013:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217042.244154:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714096768 00000100:00100000:2.0:1782217042.244165:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714096768 00000100:00100000:2.0:1782217042.244229:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 67 00000100:00100000:2.0:1782217042.244239:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+19:12311:x1868789714096768:12345-192.168.203.19@tcp:35:umount.0 00000100:00100000:2.0:1782217042.244971:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+20:12311:x1868789714096768:12345-192.168.203.19@tcp:35:umount.0 Request processed in 727us (964us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1782217042.244981:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 67 00000100:00100000:3.0:1782217042.248992:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217042.249939:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714097024 00000100:00100000:1.0:1782217042.249976:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714097024 00000100:00100000:1.0:1782217042.250275:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 68 00000100:00100000:1.0:1782217042.250291:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664e8f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+20:12311:x1868789714097024:12345-192.168.203.19@tcp:35:umount.0 00000100:00100000:1.0:1782217042.251625:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664e8f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10ba4d21-74e8-42e8-8e52-48a327751cbd+21:12311:x1868789714097024:12345-192.168.203.19@tcp:35:umount.0 Request processed in 1327us (2636us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1782217042.251640:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 68 00000100:00100000:3.0:1782217042.256330:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217042.256857:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714097280 00000100:00100000:2.0:1782217042.256870:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714097280 00000100:00100000:2.0:1782217042.256946:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 69 00000100:00100000:2.0:1782217042.256957:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+21:12311:x1868789714097280:12345-192.168.203.19@tcp:35:umount.0 00000100:00100000:2.0:1782217042.257586:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10ba4d21-74e8-42e8-8e52-48a327751cbd+22:12311:x1868789714097280:12345-192.168.203.19@tcp:35:umount.0 Request processed in 625us (1266us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1782217042.257596:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 69 00000100:00100000:3.0:1782217042.264648:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217042.264696:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217042.264793:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714097408 00000100:00100000:0.0:1782217042.264806:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714097408 00000100:00100000:0.0:1782217042.264914:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714097536 00000100:00100000:0.0:1782217042.264918:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714097536 00000100:00100000:0.0:1782217042.264953:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 19 00000100:00100000:0.0:1782217042.264983:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649195500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+14:2357:x1868789714097408:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217042.265004:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217042.265031:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e67fd06e00/0xf210a9075089eb8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62019b expref: 14 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217042.265053:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217042.265141:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649195500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+13:2357:x1868789714097408:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 160us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217042.265149:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 19 00000100:00100000:0.0:1782217042.265170:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 20 00000100:00100000:0.0:1782217042.265177:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649197800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+12:2357:x1868789714097536:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217042.265185:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217042.265194:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e67a2d2800/0xf210a9075089eaf4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620163 expref: 12 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217042.265204:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217042.265222:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649197800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+11:2357:x1868789714097536:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 46us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217042.265228:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 20 00000100:00100000:3.0:1782217042.267827:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217042.267962:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217042.268127:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714097920 00000100:00100000:2.0:1782217042.268140:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714097920 00000100:00100000:2.0:1782217042.268217:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 73 00000100:00100000:2.0:1782217042.268230:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+7:2355:x1868789714097920:12345-192.168.203.19@tcp:9:umount.0 00000020:00000080:2.0:1782217042.268270:0:6580:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf210a9075089f0c7 00000020:00010000:2.0:1782217042.268279:0:6580:0:(genops.c:1942:obd_stale_export_put()) Put export ffff88e67f5d9000: total 0 00000100:00080000:2.0:1782217042.268285:0:6580:0:(import.c:65:import_set_state_nolock()) ffff88e6738d7800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782217042.268329:0:6580:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1782217042.268753:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2355:x1868789714097920:12345-192.168.203.19@tcp:9:umount.0 Request processed in 523us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217042.268764:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 73 00000020:00010000:0.0:1782217042.269858:0:11514:0:(genops.c:1928:obd_stale_export_get()) Get export ffff88e67f5d9000: total 0 00010000:00010000:0.0:1782217042.269934:0:11514:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff88e67f5d9000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1782217042.270008:0:11514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4c4199c/0xf210a9075089f46a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62043b expref: 4 pid: 11864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217042.270051:0:11514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069c90b12/0xf210a9075089fb08 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620609 expref: 3 pid: 7991 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217042.270100:0:11514:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff88e67f5d9000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1782217042.270122:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217042.270125:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217042.270127:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782217042.270139:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782217042.270761:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714098048 00000100:00100000:1.0:1782217042.270776:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714098048 00000100:00100000:0.0:1782217042.271094:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 21 00000100:00100000:0.0:1782217042.271114:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649194700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+11:2359:x1868789714098048:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217042.271134:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217042.271151:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e6738af000/0xf210a9075089ed78 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620266 expref: 11 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217042.271166:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217042.271491:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649194700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:2359:x1868789714098048:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 386us (3527us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217042.271501:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 21 00000100:00100000:0.0:1782217042.274433:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217042.274626:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714098176 00000100:00100000:3.0:1782217042.274638:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714098176 00000100:00100000:3.0:1782217042.274757:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 74 00000100:00100000:3.0:1782217042.274769:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67fcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+5:2355:x1868789714098176:12345-192.168.203.19@tcp:9:umount.0 00000020:00000080:3.0:1782217042.274811:0:7991:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf210a9075089ee66 00000100:00080000:3.0:1782217042.274822:0:7991:0:(import.c:65:import_set_state_nolock()) ffff88e6755ce800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782217042.274905:0:7991:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1782217042.275248:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67fcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+2:2355:x1868789714098176:12345-192.168.203.19@tcp:9:umount.0 Request processed in 480us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217042.275257:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 74 00010000:00010000:2.0:1782217042.275514:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782217042.276214:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782217042.283276:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217042.283495:0:6855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714099200 00000100:00100000:3.0:1782217042.283509:0:6855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714099200 00000100:00100000:3.0:1782217042.283677:0:6855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 240 00000100:00100000:3.0:1782217042.283692:0:6855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e646104a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+22:2355:x1868789714099200:12345-192.168.203.19@tcp:39:umount.0 00000020:00000080:3.0:1782217042.283739:0:6855:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf210a9075089eb02 00000020:00010000:3.0:1782217042.283760:0:6855:0:(genops.c:1942:obd_stale_export_put()) Put export ffff88e652460800: total 0 00000100:00080000:3.0:1782217042.283765:0:6855:0:(import.c:65:import_set_state_nolock()) ffff88e652465000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782217042.283851:0:6855:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1782217042.284580:0:6855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e646104a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10ba4d21-74e8-42e8-8e52-48a327751cbd+21:2355:x1868789714099200:12345-192.168.203.19@tcp:39:umount.0 Request processed in 887us (1314us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1782217042.284592:0:6855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 240 00000020:00010000:1.0:1782217042.285559:0:11515:0:(genops.c:1928:obd_stale_export_get()) Get export ffff88e652460800: total 0 00010000:00010000:0.0:1782217042.286283:0:11515:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff88e652460800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1782217042.286329:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88e650a64700) 00010000:00010000:0.0:1782217042.286334:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782217042.286348:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030400/0xf210a9075089ee3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620290 expref: 20 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217042.286370:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88e660936e00) 00010000:00010000:0.0:1782217042.286372:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782217042.286393:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07200/0xf210a9075089f9e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205bc expref: 19 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217042.286409:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88e67a811000) 00010000:00010000:0.0:1782217042.286411:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782217042.286415:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06600/0xf210a9075089f4e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62045e expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217042.286428:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88e67a811b00) 00010000:00010000:0.0:1782217042.286430:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782217042.286434:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a9075089f34b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6203ee expref: 17 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217042.286448:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e650a64300) 00010000:00010000:0.0:1782217042.286450:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782217042.286454:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a9075089f4cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620457 expref: 16 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217042.286466:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88e67a811700) 00010000:00010000:0.0:1782217042.286468:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217042.286472:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07000/0xf210a9075089ede8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62027b expref: 15 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217042.286491:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88e660936e00) 00010000:00010000:0.0:1782217042.286493:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1782217042.286496:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171000/0xf210a9075089faf3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620602 expref: 14 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217042.286507:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88e67a811b00) 00010000:00010000:0.0:1782217042.286514:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782217042.286519:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07600/0xf210a9075089f42b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620426 expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217042.286533:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88e67a811b00) 00010000:00010000:0.0:1782217042.286535:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1782217042.286538:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b000/0xf210a9075089f455 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620434 expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217042.286553:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88e660936e00) 00010000:00010000:0.0:1782217042.286554:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782217042.286558:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171e00/0xf210a9075089fac9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6205f4 expref: 11 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217042.286572:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88e650a64700) 00010000:00010000:0.0:1782217042.286575:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782217042.286578:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd07c00/0xf210a9075089f129 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620362 expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217042.286591:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88e650a64b00) 00010000:00010000:0.0:1782217042.286593:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782217042.286596:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e640030a00/0xf210a9075089edcc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620274 expref: 9 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217042.287229:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88e67a811000) 00010000:00010000:0.0:1782217042.287237:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782217042.287245:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682170600/0xf210a9075089f7c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620530 expref: 8 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217042.287280:0:11515:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff88e652460800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1782217042.287305:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217042.287308:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217042.287310:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1782217042.447236:0:7488:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 10ba4d21-74e8-42e8-8e52-48a327751cbd 00000020:00000080:1.0:1782217042.447251:0:7488:0:(genops.c:906:class_export_put()) final put ffff88e67f5d9000/10ba4d21-74e8-42e8-8e52-48a327751cbd 00000020:00000080:2.0:1782217042.447516:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff88e67f5d9000/10ba4d21-74e8-42e8-8e52-48a327751cbd for lustre-OST0001 00000020:00000080:2.0:1782217042.447582:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff88e6738d7800 for lustre-OST0001 00000001:00080000:0.0:1782217042.453382:0:5805:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00080000:0.0:1782217042.453417:0:5805:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:0.0:1782217042.453437:0:5805:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 10ba4d21-74e8-42e8-8e52-48a327751cbd 00000001:00080000:0.0:1782217042.453448:0:5805:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1782217042.453453:0:5805:0:(genops.c:906:class_export_put()) final put ffff88e652460800/10ba4d21-74e8-42e8-8e52-48a327751cbd 00000020:00000080:2.0:1782217042.453532:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff88e652460800/10ba4d21-74e8-42e8-8e52-48a327751cbd for lustre-MDT0000 00000020:00000080:2.0:1782217042.453708:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff88e652465000 for lustre-MDT0000 00010000:00010000:2.0:1782217042.516399:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217043.540280:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217043.926984:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782217043.927016:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f79d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733999872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782217043.928944:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217043.929773:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789733999872 00000100:00100000:1.0:1782217043.929794:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789733999872 00000100:00100000:1.0:1782217043.929909:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1782217043.929922:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733999872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782217043.929973:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782217043.930052:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789733999872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217043.930060:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1782217043.930720:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782217043.930786:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f79d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789733999872:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1782217044.015559:0:6609:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 10ba4d21-74e8-42e8-8e52-48a327751cbd 00000020:00000080:3.0:1782217044.015571:0:6609:0:(genops.c:906:class_export_put()) final put ffff88e6755cc800/10ba4d21-74e8-42e8-8e52-48a327751cbd 00000020:00000080:2.0:1782217044.015751:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff88e6755cc800/10ba4d21-74e8-42e8-8e52-48a327751cbd for lustre-OST0000 00000020:00000080:2.0:1782217044.015958:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff88e6755ce800 for lustre-OST0000 00000100:00100000:3.0:1782217044.016962:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217044.017008:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217044.017290:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714099328 00000100:00100000:0.0:1782217044.017302:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714099328 00000100:00100000:0.0:1782217044.017372:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714099456 00000100:00100000:0.0:1782217044.017375:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714099456 00000100:00100000:0.0:1782217044.017402:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 22 00000100:00100000:0.0:1782217044.017413:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649196680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+11:2359:x1868789714099328:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217044.017431:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217044.017463:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e67a2d2000/0xf210a9075089ebd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6201b0 expref: 11 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217044.017485:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217044.017568:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649196680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+10:2359:x1868789714099328:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 156us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217044.017577:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 22 00000100:00100000:3.0:1782217044.017769:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 23 00000100:00100000:3.0:1782217044.017780:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649197100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+9:2359:x1868789714099456:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217044.017791:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217044.017801:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e67a2d3c00/0xf210a9075089ebdb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6201da expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217044.017811:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217044.017832:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649197100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+8:2359:x1868789714099456:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 56us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217044.017839:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 23 00000100:00100000:3.0:1782217044.018702:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217044.019012:0:8300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714099584 00000100:00100000:0.0:1782217044.019021:0:8300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714099584 00000100:00100000:0.0:1782217044.019075:0:8300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 24 00000100:00100000:0.0:1782217044.019084:0:8300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+8:2359:x1868789714099584:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217044.019106:0:8300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217044.019124:0:8300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e640031400/0xf210a9075089ed71 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62025f expref: 8 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217044.019141:0:8300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217044.019291:0:8300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+7:2359:x1868789714099584:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 206us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217044.019299:0:8300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 24 00000100:00100000:0.0:1782217044.028464:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217044.028569:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714099840 00000100:00100000:1.0:1782217044.028581:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714099840 00000100:00100000:1.0:1782217044.028679:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 241 00000100:00100000:1.0:1782217044.028691:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f79d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+6:2355:x1868789714099840:12345-192.168.203.19@tcp:39:umount.0 00000020:00000080:1.0:1782217044.028741:0:5784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf210a9075089ebe9 00000020:00010000:1.0:1782217044.028751:0:5784:0:(genops.c:1942:obd_stale_export_put()) Put export ffff88e674188800: total 0 00000100:00080000:1.0:1782217044.028756:0:5784:0:(import.c:65:import_set_state_nolock()) ffff88e67418c800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782217044.028782:0:5784:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:1.0:1782217044.029377:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f79d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb+5:2355:x1868789714099840:12345-192.168.203.19@tcp:39:umount.0 Request processed in 674us (913us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1782217044.029389:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 241 00000020:00010000:2.0:1782217044.029948:0:5771:0:(genops.c:1928:obd_stale_export_get()) Get export ffff88e674188800: total 0 00010000:00010000:2.0:1782217044.030003:0:5771:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff88e674188800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1782217044.030047:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e650a64300) 00010000:00010000:2.0:1782217044.030064:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782217044.030076:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67fd06c00/0xf210a9075089fb16 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620610 expref: 4 pid: 6855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217044.030110:0:5771:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff88e674188800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1782217044.030123:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217044.030126:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217044.030128:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782217044.030180:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782217044.050015:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217044.050120:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714100096 00000100:00100000:0.0:1782217044.050134:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714100096 00000100:00100000:0.0:1782217044.050248:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 301 00000100:00100000:0.0:1782217044.050262:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+7:2355:x1868789714100096:12345-192.168.203.19@tcp:251:umount.0 00000020:00000080:0.0:1782217044.050323:0:5775:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf210a9075089eadf 00000020:00010000:0.0:1782217044.050334:0:5775:0:(genops.c:1942:obd_stale_export_put()) Put export ffff88e652465800: total 0 00000100:00080000:0.0:1782217044.050339:0:5775:0:(import.c:65:import_set_state_nolock()) ffff88e652467000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1782217044.050439:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e+3:2355:x1868789714100096:12345-192.168.203.19@tcp:251:umount.0 Request processed in 180us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217044.050448:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 301 00000020:00010000:1.0:1782217044.050521:0:11515:0:(genops.c:1928:obd_stale_export_get()) Get export ffff88e652465800: total 0 00010000:00010000:1.0:1782217044.050526:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217044.050589:0:11515:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff88e652465800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1782217044.050629:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e67437be00/0xf210a9075089eb95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6201a2 expref: 2 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217044.050650:0:11515:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff88e652465800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1782217044.050660:0:11515:0:(genops.c:906:class_export_put()) final put ffff88e652465800/4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e 00010000:00010000:1.0:1782217044.050676:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217044.050678:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217044.050679:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782217044.051327:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff88e652465800/4a8ba4e9-3aad-4e02-abfb-c739c8ffa98e for MGS 00000020:00000080:2.0:1782217044.051373:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff88e652467000 for MGS 00010000:00010000:2.0:1782217044.565170:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217045.588170:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1782217045.961668:0:12809:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000100:00100000:3.0:1782217045.973831:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789734000000:0@lo:400:kworker.0 00000100:00100000:2.0:1782217045.973857:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67420c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1868789734000384:0@lo:400:kworker.0 00000100:00100000:1.0:1782217045.975515:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789734000256:0@lo:400:kworker.0 00000100:00100000:2.0:1782217045.975920:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217045.976116:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734000384 00000100:00100000:0.0:1782217045.976124:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734000384 00000100:00100000:0.0:1782217045.976176:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1782217045.976185:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e646106680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868789734000384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217045.976240:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e646106680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868789734000384:12345-0@lo:400:kworker.0 Request processed in 57us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217045.976247:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:2.0:1782217045.978695:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782217045.978746:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67420c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1868789734000384:0@lo:400:kworker.0 00000100:00100000:2.0:1782217045.981996:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789734000128:0@lo:400:kworker.0 00000100:00100000:2.0:1782217045.982071:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217045.982172:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67420d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789734000640:0@lo:400:kworker.0 00000100:00100000:2.0:1782217045.982201:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217045.982439:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217045.982483:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67420ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1868789734000512:0@lo:400:kworker.0 00000100:00100000:3.0:1782217045.982512:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217045.982551:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734000000 00000100:00100000:2.0:1782217045.982559:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734000000 00000100:00100000:2.0:1782217045.982619:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1782217045.982628:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e1b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+19:3304:x1868789734000000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217045.982686:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e1b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:526a4802-b871-4bcf-870f-067f11655366+19:3304:x1868789734000000:12345-0@lo:400:kworker.0 Request processed in 59us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217045.982693:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1782217045.983025:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217045.984989:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734000128 00000100:00100000:2.0:1782217045.985002:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734000128 00000100:00100000:2.0:1782217045.985055:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734000512 00000100:00100000:2.0:1782217045.985059:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734000512 00000100:00100000:2.0:1782217045.985100:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1782217045.985108:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e646107800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789734000128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217045.985185:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e646107800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789734000128:12345-0@lo:400:kworker.0 Request processed in 77us (3113us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217045.985191:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1782217045.985207:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1782217045.985214:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67420d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868789734000512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217045.985245:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67420d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868789734000512:12345-0@lo:400:kworker.0 Request processed in 32us (2732us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217045.985251:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:2.0:1782217045.985268:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782217045.985297:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67420ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1868789734000512:0@lo:400:kworker.0 00000100:00100000:2.0:1782217045.985351:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789734000128:0@lo:400:kworker.0 00000100:00100000:3.0:1782217045.985461:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789734000000:0@lo:400:kworker.0 00000100:00100000:3.0:1782217045.985492:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734000640 00000100:00100000:3.0:1782217045.985496:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734000640 00000100:00100000:3.0:1782217045.985542:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734000256 00000100:00100000:3.0:1782217045.985546:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734000256 00000100:00100000:3.0:1782217045.985568:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1782217045.985574:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a0e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789734000640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217045.985628:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a0e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789734000640:12345-0@lo:400:kworker.0 Request processed in 53us (3426us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217045.985635:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1782217045.985647:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1782217045.985653:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789734000256:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1782217045.985954:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782217045.985958:0:5779:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782217045.988841:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67420d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789734000640:0@lo:400:kworker.0 00000100:00100000:3.0:1782217045.989523:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789734000256:12345-0@lo:400:kworker.0 Request processed in 3864us (6493us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217045.989535:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1782217045.989794:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789734000256:0@lo:400:kworker.0 00000020:01000004:2.0:1782217045.990138:0:12809:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1782217045.990182:0:12809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3e00/0xf210a9075089eb64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089eb6b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217045.990194:0:12809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3e00/0xf210a9075089eb64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089eb6b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217045.990201:0:12809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3e00/0xf210a9075089eb64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf210a9075089eb6b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217045.990208:0:12809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3e00/0xf210a9075089eb64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf210a9075089eb6b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217045.990247:0:12809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1782217045.990253:0:12809:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1782217045.990275:0:12809:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1782217045.990279:0:12809:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1782217045.990284:0:12809:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1782217045.990305:0:12809:0:(import.c:65:import_set_state_nolock()) ffff88e65057a800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1782217045.990390:0:3300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1868789734000768:0@lo:39:umount.0 00000100:00100000:1.0:1782217045.990445:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217045.990640:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734000768 00000100:00100000:2.0:1782217045.990646:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734000768 00000100:00100000:2.0:1782217045.990746:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1782217045.990753:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1868789734000768:12345-0@lo:39:umount.0 00000020:00000080:2.0:1782217045.990777:0:5785:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf210a9075089e8fc 00000100:00080000:2.0:1782217045.990784:0:5785:0:(import.c:65:import_set_state_nolock()) ffff88e6745ea800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1782217045.990834:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3300:x1868789734000768:12345-0@lo:39:umount.0 Request processed in 81us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217045.990841:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1782217045.990848:0:5785:0:(genops.c:906:class_export_put()) final put ffff88e6745ed000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1782217045.990905:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782217045.990911:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3e00/0xf210a9075089eb64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf210a9075089eb6b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217045.990919:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67a2d3e00 already unused, calling callback (ffffffffc1d2fc20) 10000000:00010000:0.0:1782217045.990922:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3e00/0xf210a9075089eb64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf210a9075089eb6b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217045.990929:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3e00/0xf210a9075089eb64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xf210a9075089eb6b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782217045.990935:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3e00/0xf210a9075089eb64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xf210a9075089eb6b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782217045.990940:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1782217045.990942:0:5771:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1782217045.990945:0:5771:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1782217045.990966:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3e00/0xf210a9075089eb64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf210a9075089eb6b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217045.990971:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782217045.990988:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3e00/0xf210a9075089eb64 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf210a9075089eb6b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217045.991007:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3e00/0xf210a9075089eb64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf210a9075089eb6b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217045.991017:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217045.991019:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217045.991021:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782217045.991067:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f79ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:526a4802-b871-4bcf-870f-067f11655366:3302:1868789734000896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782217045.991107:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217045.991179:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734000896 00000100:00100000:0.0:1782217045.991183:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734000896 00000100:00100000:0.0:1782217045.991221:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782217045.991227:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e646ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:526a4802-b871-4bcf-870f-067f11655366+19:3302:x1868789734000896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782217045.991235:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217045.991248:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e67fd06a00/0xf210a9075089eb6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf210a9075089eb64 expref: 19 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217045.991259:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217045.991288:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e646ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:526a4802-b871-4bcf-870f-067f11655366+18:3302:x1868789734000896:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217045.991295:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782217045.991342:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f79ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:526a4802-b871-4bcf-870f-067f11655366:3302:1868789734000896:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782217045.991397:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782217045.991415:0:3300:0:(import.c:65:import_set_state_nolock()) ffff88e65057a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1782217045.991430:0:3300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1868789734000768:0@lo:39:umount.0 00000100:00080000:0.0:1782217045.991482:0:12809:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1782217045.991485:0:12809:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1782217045.991488:0:12809:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1782217045.992203:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff88e6745ed000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1782217045.992249:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff88e6745ea800 for lustre-MDT0000 00010000:00010000:0.0:1782217045.993918:0:12809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67437a200/0xf210a9075089eb72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089eb79 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217045.993934:0:12809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67437a200/0xf210a9075089eb72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089eb79 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217045.993960:0:12809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67437a200/0xf210a9075089eb72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf210a9075089eb79 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217045.993966:0:12809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.119@tcp lock: ffff88e67437a200/0xf210a9075089eb72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf210a9075089eb79 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217045.993991:0:12809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782217045.993998:0:12809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e641492800/0xf210a9075089ea99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089eaa0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217045.994004:0:12809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e641492800/0xf210a9075089ea99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089eaa0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217045.994010:0:12809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e641492800/0xf210a9075089ea99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf210a9075089eaa0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217045.994016:0:12809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.119@tcp lock: ffff88e641492800/0xf210a9075089ea99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf210a9075089eaa0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217045.994035:0:12809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1782217045.994042:0:12809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e6738af800/0xf210a9075089ed9b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089eda2 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217045.994049:0:12809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e6738af800/0xf210a9075089ed9b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089eda2 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217045.994055:0:12809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e6738af800/0xf210a9075089ed9b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf210a9075089eda2 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217045.994067:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782217045.994071:0:12809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.119@tcp lock: ffff88e6738af800/0xf210a9075089ed9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf210a9075089eda2 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217045.994073:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e67437a200/0xf210a9075089eb72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf210a9075089eb79 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217045.994092:0:12809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1782217045.994103:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782217045.994106:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437a200 already unused, calling callback (ffffffffc1d2fc20) 00010000:00010000:0.0:1782217045.994107:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e641492800/0xf210a9075089ea99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf210a9075089eaa0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782217045.994110:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e67437a200/0xf210a9075089eb72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf210a9075089eb79 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217045.994114:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e641492800 already unused, calling callback (ffffffffc1d2fc20) 10000000:00010000:0.0:1782217045.994116:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e641492800/0xf210a9075089ea99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf210a9075089eaa0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217045.994119:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e67437a200/0xf210a9075089eb72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xf210a9075089eb79 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217045.994124:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e641492800/0xf210a9075089ea99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf210a9075089eaa0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782217045.994126:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e67437a200/0xf210a9075089eb72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xf210a9075089eb79 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782217045.994131:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e641492800/0xf210a9075089ea99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf210a9075089eaa0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782217045.994132:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1782217045.994135:0:5772:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:0.0:1782217045.994135:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1782217045.994137:0:5771:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1782217045.994139:0:5771:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1782217045.994164:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: ffff88e67437a200/0xf210a9075089eb72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf210a9075089eb79 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217045.994164:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: ffff88e641492800/0xf210a9075089ea99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf210a9075089eaa0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217045.994170:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782217045.994178:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782217045.994190:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e67437a200/0xf210a9075089eb72 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf210a9075089eb79 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217045.994190:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e641492800/0xf210a9075089ea99 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf210a9075089eaa0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217045.994197:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e67437a200/0xf210a9075089eb72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf210a9075089eb79 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217045.994198:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e641492800/0xf210a9075089ea99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf210a9075089eaa0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217045.994210:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217045.994213:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e6738af800/0xf210a9075089ed9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf210a9075089eda2 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217045.994213:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217045.994214:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217045.994217:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217045.994219:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738af800 already unused, calling callback (ffffffffc1d2fc20) 10000000:00010000:3.0:1782217045.994222:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e6738af800/0xf210a9075089ed9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf210a9075089eda2 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217045.994227:0:12809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e641492200/0xf210a9075089e85b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089e862 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217045.994228:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e6738af800/0xf210a9075089ed9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf210a9075089eda2 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782217045.994235:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e6738af800/0xf210a9075089ed9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf210a9075089eda2 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217045.994235:0:12809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e641492200/0xf210a9075089e85b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089e862 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782217045.994241:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782217045.994242:0:12809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e641492200/0xf210a9075089e85b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf210a9075089e862 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782217045.994243:0:5772:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1782217045.994245:0:5772:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1782217045.994248:0:12809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.119@tcp lock: ffff88e641492200/0xf210a9075089e85b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf210a9075089e862 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217045.994255:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: ffff88e6738af800/0xf210a9075089ed9b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf210a9075089eda2 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217045.994257:0:12809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782217045.994260:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:0.0:1782217045.994260:0:12809:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1782217045.994263:0:12809:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1782217045.994273:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e6738af800/0xf210a9075089ed9b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf210a9075089eda2 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217045.994287:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e6738af800/0xf210a9075089ed9b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf210a9075089eda2 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1782217045.994288:0:12809:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1782217045.994291:0:12809:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1782217045.994295:0:12809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00010000:00010000:3.0:1782217045.994296:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217045.994298:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e641492200/0xf210a9075089e85b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf210a9075089e862 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1782217045.994300:0:12809:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00010000:00010000:3.0:1782217045.994304:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e641492200 already unused, calling callback (ffffffffc1d2fc20) 10000000:00010000:3.0:1782217045.994307:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e641492200/0xf210a9075089e85b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf210a9075089e862 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1782217045.994307:0:12809:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff88e67f2ad000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1782217045.994313:0:12809:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff88e643531000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:3.0:1782217045.994314:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e641492200/0xf210a9075089e85b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf210a9075089e862 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782217045.994320:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e641492200/0xf210a9075089e85b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf210a9075089e862 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1782217045.994321:0:12809:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff88e674188800 e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb 192.168.203.19@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 10000000:01000000:3.0:1782217045.994326:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00000020:00080000:0.0:1782217045.994326:0:12809:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff88e6745f4d40) has exports, disconnecting them 10000000:01000000:3.0:1782217045.994328:0:5772:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1782217045.994329:0:5772:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000020:00080000:0.0:1782217045.994330:0:12809:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff88e67f2ad000), last request at 1782217045 00010000:00010000:3.0:1782217045.994340:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: ffff88e641492200/0xf210a9075089e85b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf210a9075089e862 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1782217045.994343:0:12809:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf210a9075089ea61 00010000:00010000:3.0:1782217045.994345:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782217045.994351:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e641492200/0xf210a9075089e85b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf210a9075089e862 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217045.994356:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e641492200/0xf210a9075089e85b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf210a9075089e862 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1782217045.994356:0:12809:0:(import.c:65:import_set_state_nolock()) ffff88e67f2ad800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1782217045.994387:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1782217045.994402:0:12809:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff88e67f2ad000): rc 0 00000020:00000080:0.0:1782217045.994406:0:12809:0:(genops.c:906:class_export_put()) final put ffff88e67f2ad000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1782217045.994415:0:12809:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff88e643531000), last request at 1782217045 00000020:00000080:0.0:1782217045.994418:0:12809:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf210a9075089e9d5 00000100:00080000:0.0:1782217045.994424:0:12809:0:(import.c:65:import_set_state_nolock()) ffff88e643535800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1782217045.994432:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1782217045.994438:0:12809:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff88e643531000): rc 0 00000020:00000080:0.0:1782217045.994440:0:12809:0:(genops.c:906:class_export_put()) final put ffff88e643531000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1782217045.994446:0:12809:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb4d082ecbae0 00000100:00080000:0.0:1782217045.994466:0:12809:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1782217045.994470:0:12809:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1782217045.994483:0:12809:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1782217045.994543:0:12809:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1782217045.994554:0:12809:0:(import.c:65:import_set_state_nolock()) ffff88e67f309800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1782217045.994563:0:12809:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1782217045.994565:0:12809:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1782217045.994573:0:12809:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:3.0:1782217045.994717:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217045.994718:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217045.994720:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217045.994737:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67420e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:526a4802-b871-4bcf-870f-067f11655366:3301:1868789734001280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782217045.994799:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217045.994842:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782217045.994849:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67420e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:526a4802-b871-4bcf-870f-067f11655366:3301:1868789734001408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782217045.994870:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217045.994931:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734001280 00000100:00100000:3.0:1782217045.994937:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734001280 00000100:00100000:3.0:1782217045.995068:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734001408 00000100:00100000:3.0:1782217045.995072:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734001408 00000100:00100000:3.0:1782217045.995114:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782217045.995123:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67420ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:526a4802-b871-4bcf-870f-067f11655366+19:3301:x1868789734001280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782217045.995136:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217045.995150:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e67437b600/0xf210a9075089eda2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf210a9075089ed9b expref: 19 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217045.995163:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217045.995196:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67420ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:526a4802-b871-4bcf-870f-067f11655366+18:3301:x1868789734001280:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217045.995203:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782217045.995220:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782217045.995226:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67420fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:526a4802-b871-4bcf-870f-067f11655366+17:3301:x1868789734001408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782217045.995234:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217045.995242:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e653161a00/0xf210a9075089e862 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf210a9075089e85b expref: 17 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217045.995262:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217045.995285:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67420fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:526a4802-b871-4bcf-870f-067f11655366+16:3301:x1868789734001408:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217045.995291:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782217045.995328:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67420e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:526a4802-b871-4bcf-870f-067f11655366:3301:1868789734001408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782217045.995337:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67420e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:526a4802-b871-4bcf-870f-067f11655366:3301:1868789734001280:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1782217045.995357:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff88e67f2ad000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1782217045.995463:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff88e643531000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1782217045.995484:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff88e67f2ad800 for lustre-MDT0000 00000020:00000080:3.0:1782217045.995488:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff88e643535800 for lustre-MDT0000 00000100:00100000:3.0:1782217045.995502:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67420ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789734001152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782217045.995526:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217045.995546:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782217045.995552:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f79ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789734001024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782217045.995570:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217045.995594:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734001152 00000100:00100000:3.0:1782217045.995598:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734001152 00000100:00100000:3.0:1782217045.995619:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734001024 00000100:00100000:3.0:1782217045.995622:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734001024 00000100:00100000:3.0:1782217045.995637:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782217045.995643:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67420e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:526a4802-b871-4bcf-870f-067f11655366+17:3304:x1868789734001152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782217045.995651:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217045.995660:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e67a2d2c00/0xf210a9075089eb79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf210a9075089eb72 expref: 17 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217045.995681:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217045.995707:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67420e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:526a4802-b871-4bcf-870f-067f11655366+16:3304:x1868789734001152:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (180us total) trans 0 rc 0/0 00010000:00010000:1.0:1782217045.995707:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217045.995713:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782217045.995717:0:3300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f79f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1868789734001536:0@lo:9:umount.0 00000100:00100000:3.0:1782217045.995725:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782217045.995730:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67420e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:526a4802-b871-4bcf-870f-067f11655366+15:3304:x1868789734001024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782217045.995737:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217045.995745:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e67a2d2e00/0xf210a9075089eaa0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf210a9075089ea99 expref: 15 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217045.995748:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782217045.995754:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217045.995774:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67420e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:526a4802-b871-4bcf-870f-067f11655366+14:3304:x1868789734001024:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217045.995780:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782217045.995789:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734001536 00000100:00100000:1.0:1782217045.995793:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734001536 00000100:00100000:3.0:1782217045.995804:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f79ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789734001024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782217045.995811:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67420ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:526a4802-b871-4bcf-870f-067f11655366:3304:1868789734001152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782217045.995820:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1782217045.995826:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a1e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1868789734001536:12345-0@lo:9:umount.0 00000020:00000080:1.0:1782217045.995848:0:6578:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf210a9075089e9e3 00000100:00080000:1.0:1782217045.995856:0:6578:0:(import.c:65:import_set_state_nolock()) ffff88e643534000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782217045.995914:0:6578:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1782217045.996239:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a1e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3300:x1868789734001536:12345-0@lo:9:umount.0 Request processed in 411us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217045.996246:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1782217045.996275:0:3300:0:(import.c:65:import_set_state_nolock()) ffff88e67f309800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1782217045.996286:0:3300:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1782217045.996288:0:3300:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1782217045.996291:0:3300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f79f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1868789734001536:0@lo:9:umount.0 00010000:00010000:3.0:1782217045.996472:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782217045.996505:0:12809:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1782217045.996522:0:12809:0:(import.c:65:import_set_state_nolock()) ffff88e652466800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1782217045.996560:0:12809:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff88e6745f4d40) has no exports 00000100:00100000:1.0:1782217045.996684:0:3300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f79c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1868789734001664:0@lo:9:umount.0 00000100:00100000:1.0:1782217045.996716:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217045.996748:0:11864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734001664 00000100:00100000:1.0:1782217045.996752:0:11864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734001664 00000100:00100000:1.0:1782217045.996781:0:11864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1782217045.996787:0:11864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3300:x1868789734001664:12345-0@lo:9:umount.0 00000020:00000080:1.0:1782217045.996806:0:11864:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf210a9075089eaca 00000100:00080000:1.0:1782217045.996811:0:11864:0:(import.c:65:import_set_state_nolock()) ffff88e67a474800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782217045.996832:0:11864:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1782217045.997070:0:11864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3300:x1868789734001664:12345-0@lo:9:umount.0 Request processed in 282us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217045.997089:0:11864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:1.0:1782217045.997110:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782217045.997126:0:3300:0:(import.c:65:import_set_state_nolock()) ffff88e652466800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1782217045.997143:0:3300:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1782217045.997145:0:3300:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1782217045.997148:0:3300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f79c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1868789734001664:0@lo:9:umount.0 00010000:00010000:0.0:1782217045.998780:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1782217046.022118:0:12809:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff88e6745f4d40) has no exports 00000020:00000080:2.0:1782217046.082035:0:12809:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf210a9075089e8b6 00000020:00000080:2.0:1782217046.082049:0:12809:0:(genops.c:906:class_export_put()) final put ffff88e679aac800/lustre-QMT0000_UUID 00000020:01000000:2.0:1782217046.082121:0:12809:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1782217046.082204:0:12809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782217046.082214:0:12809:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1782217046.082218:0:12809:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff88e675584d40) has no exports 00000020:00000080:0.0:1782217046.082504:0:12809:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf210a9075089e8af 00000020:00000080:0.0:1782217046.082511:0:12809:0:(genops.c:906:class_export_put()) final put ffff88e679a28800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1782217046.082536:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff88e679aac800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1782217046.082763:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff88e679a28800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1782217046.082828:0:12809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782217046.082849:0:12809:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1782217046.082853:0:12809:0:(genops.c:906:class_export_put()) final put ffff88e679a8d800/lustre-QMT0000_UUID 00000020:00000080:0.0:1782217046.082855:0:12809:0:(genops.c:865:class_export_destroy()) destroying export ffff88e679a8d800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1782217046.082863:0:12809:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:1.0:1782217046.612851:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1782217047.561162:0:5805:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb 00000001:00080000:3.0:1782217047.561181:0:5805:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:3.0:1782217047.561187:0:5805:0:(genops.c:906:class_export_put()) final put ffff88e674188800/e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb 00000020:00000080:2.0:1782217047.561237:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff88e674188800/e4b1b534-4f41-4f7c-9c1b-8bb89c36f5fb for lustre-MDT0000 00000020:00000080:2.0:1782217047.561286:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff88e67418c800 for lustre-MDT0000 00000001:00100000:2.0:1782217047.572178:0:7488:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1782217047.572187:0:7488:0:(genops.c:906:class_export_put()) final put ffff88e67a473000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1782217047.572318:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff88e67a473000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1782217047.572361:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff88e67a474800 for lustre-OST0001 00010000:00010000:3.0:1782217047.636195:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1782217048.087575:0:12809:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff88e67a3c5540 - data ffff88e67f9286c0/ffff88e67a617400 00000020:01000000:2.0:1782217048.087710:0:12809:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff88e65c030360 - data ffff88e6803ad798/ffff88e6644d4c00 00000001:00000004:2.0:1782217048.100390:0:12809:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:1.0:1782217048.200389:0:12809:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1782217048.200414:0:12809:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:1.0:1782217048.200440:0:12809:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1782217048.200443:0:12809:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1782217048.201718:0:6596:0:(osp_sync.c:1339:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1782217048.201725:0:6596:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:2.0:1782217048.201738:0:6596:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1782217048.208055:0:12809:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1782217048.208076:0:12809:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1782217048.208095:0:12809:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1782217048.208098:0:12809:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1782217048.208683:0:7776:0:(osp_sync.c:1339:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1782217048.208689:0:7776:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:2.0:1782217048.208699:0:7776:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1782217048.248398:0:12809:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf210a9075089e87e 00000020:00000080:2.0:1782217048.248410:0:12809:0:(genops.c:906:class_export_put()) final put ffff88e6745ef000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1782217048.248636:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff88e6745ef000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1782217048.250726:0:12809:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf210a9075089e893 00000020:00000080:2.0:1782217048.250740:0:12809:0:(genops.c:906:class_export_put()) final put ffff88e6745e8000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1782217048.250767:0:12809:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1782217048.250775:0:12809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782217048.250784:0:12809:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1782217048.250788:0:12809:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff88e6484d8000) has no exports 00000020:00000080:3.0:1782217048.250810:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff88e6745e8000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:2.0:1782217048.251088:0:12809:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1782217048.251097:0:12809:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf210a9075089eac3 00000020:00000080:2.0:1782217048.251102:0:12809:0:(genops.c:906:class_export_put()) final put ffff88e67a470000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1782217048.251112:0:12809:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1782217048.251116:0:12809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782217048.251122:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff88e67a470000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1782217048.251124:0:12809:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1782217048.251130:0:12809:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff88e67fff8000) has no exports 00000020:00000080:2.0:1782217048.251137:0:12809:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf210a9075089eabc 00000020:00000080:2.0:1782217048.251141:0:12809:0:(genops.c:906:class_export_put()) final put ffff88e652461800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1782217048.251268:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff88e652461800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1782217048.251476:0:12809:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1782217048.251481:0:12809:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1782217048.251485:0:12809:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1782217048.251489:0:12809:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1782217048.251492:0:12809:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1782217048.251529:0:12809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782217048.251543:0:12809:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782217048.251548:0:12809:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf210a9075089e95e 00000020:00000080:2.0:1782217048.251553:0:12809:0:(genops.c:906:class_export_put()) final put ffff88e643533800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1782217048.251556:0:12809:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1782217048.252501:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff88e652466800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1782217048.252514:0:38:0:(genops.c:906:class_export_put()) final put ffff88e652462800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1782217048.252518:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff88e652462800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1782217048.252524:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1782217048.252600:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff88e643533800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1782217048.253755:0:12809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782217048.253772:0:12809:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1782217048.253776:0:12809:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff88e675580000) has no exports 00000020:00000080:2.0:1782217048.253784:0:12809:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf210a9075089e957 00000020:00000080:2.0:1782217048.253791:0:12809:0:(genops.c:906:class_export_put()) final put ffff88e67f30b800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1782217048.253922:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff88e67f30b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1782217048.254264:0:12809:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1782217048.254269:0:12809:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1782217048.254272:0:12809:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1782217048.254277:0:12809:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1782217048.254280:0:12809:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1782217048.254329:0:12809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782217048.254335:0:12809:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782217048.254365:0:12809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782217048.254369:0:12809:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782217048.254372:0:12809:0:(genops.c:906:class_export_put()) final put ffff88e65057e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1782217048.254375:0:12809:0:(genops.c:865:class_export_destroy()) destroying export ffff88e65057e000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1782217048.254380:0:12809:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1782217048.254415:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff88e67f309800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1782217048.254423:0:38:0:(genops.c:906:class_export_put()) final put ffff88e67f30f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1782217048.254425:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff88e67f30f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1782217048.254432:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782217048.254527:0:12809:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf210a9075089e89a 00000020:00000080:2.0:1782217048.254533:0:12809:0:(genops.c:906:class_export_put()) final put ffff88e6745ec000/lustre-MDD0000_UUID 00000020:01000000:2.0:1782217048.255762:0:12809:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1782217048.255772:0:12809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782217048.255780:0:12809:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1782217048.255785:0:12809:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff88e6745f19c0) has no exports 00000020:00000080:2.0:1782217048.255812:0:12809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782217048.255817:0:12809:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1782217048.255822:0:12809:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf210a9075089e8a1 00000020:00000080:2.0:1782217048.255828:0:12809:0:(genops.c:906:class_export_put()) final put ffff88e6745ee800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1782217048.258251:0:12809:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88e650a2a800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1782217048.258275:0:12809:0:(obd_mount.c:701:lustre_put_lsi()) put ffff88e650a2a800 3 00000020:01000004:2.0:1782217048.258279:0:12809:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff88e650a2a800 from lustre-MDT0000 00000020:00000080:2.0:1782217048.258312:0:12809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782217048.258321:0:12809:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1782217048.258326:0:12809:0:(genops.c:906:class_export_put()) final put ffff88e6745ef800/lustre-MDT0000_UUID 00000020:00000080:2.0:1782217048.258330:0:12809:0:(genops.c:865:class_export_destroy()) destroying export ffff88e6745ef800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1782217048.258341:0:12809:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1782217048.258394:0:12809:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1782217048.258397:0:12809:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1782217048.258401:0:12809:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1782217048.258405:0:12809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782217048.258408:0:12809:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1782217048.258414:0:12809:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff88e6509bb000 526a4802-b871-4bcf-870f-067f11655366 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1782217048.258421:0:12809:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff88e6484db380) has exports, disconnecting them 00000020:00080000:2.0:1782217048.258425:0:12809:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff88e6509bb000), last request at 1782216829 00000020:00000080:2.0:1782217048.258441:0:12809:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf210a9075089e83f 00000020:00010000:2.0:1782217048.258447:0:12809:0:(genops.c:1942:obd_stale_export_put()) Put export ffff88e6509bb000: total 2 00000100:00080000:2.0:1782217048.258451:0:12809:0:(import.c:65:import_set_state_nolock()) ffff88e6509bd000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1782217048.258462:0:12809:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff88e6509bb000): rc 0 00000020:00080000:2.0:1782217048.258466:0:12809:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff88e6484db380) has no exports 00000020:00010000:1.0:1782217048.258652:0:5772:0:(genops.c:1928:obd_stale_export_get()) Get export ffff88e6509bb000: total 2 00010000:00010000:1.0:1782217048.258685:0:5772:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff88e6509bb000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1782217048.258712:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e640031200/0xf210a9075089ed94 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf210a9075089ed8d expref: 9 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217048.258731:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e682170800/0xf210a9075089e988 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf210a9075089e981 expref: 8 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217048.258746:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e653161000/0xf210a9075089eb87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf210a9075089eb80 expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217048.258755:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e6738afc00/0xf210a9075089ed86 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf210a9075089ed7f expref: 6 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217048.258767:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e67fd06000/0xf210a9075089eb33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf210a9075089eb2c expref: 5 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217048.258790:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e67fd06800/0xf210a9075089eb4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf210a9075089eb48 expref: 4 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217048.258800:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e67a2d3800/0xf210a9075089eb41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf210a9075089eb3a expref: 3 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217048.258809:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e67a2d3200/0xf210a9075089eb5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf210a9075089eb56 expref: 2 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217048.258819:0:5772:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff88e6509bb000, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1782217048.258832:0:5772:0:(genops.c:906:class_export_put()) final put ffff88e6509bb000/526a4802-b871-4bcf-870f-067f11655366 00010000:00010000:1.0:1782217048.258839:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217048.258841:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217048.258842:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782217048.259856:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff88e6745ec000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1782217048.259867:0:38:0:(genops.c:906:class_export_put()) final put ffff88e6745eb000/lustre-MDD0000_UUID 00000020:00000080:3.0:1782217048.259870:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff88e6745eb000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1782217048.259889:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1782217048.260053:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff88e6745ee800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1782217048.260060:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff88e6509bb000/526a4802-b871-4bcf-870f-067f11655366 for MGS 00000020:00000080:3.0:1782217048.260112:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff88e6509bd000 for MGS 00000100:00100000:0.0:1782217048.261787:0:5775:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff88e6525c1200:5775] 0 exiting: rc = 1 00000100:00100000:0.0:1782217048.261919:0:5776:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff88e680471800:5776] 1 exiting: rc = 0 00000100:00100000:1.0:1782217048.262228:0:5778:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff88e64477d200:5778] 2 exiting: rc = 0 00000100:00100000:2.0:1782217048.262342:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262353:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262359:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262367:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262372:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262378:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262383:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262389:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262394:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262399:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262405:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262411:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262416:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262436:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262442:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262448:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262456:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262462:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262468:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262473:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262479:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262484:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262489:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262495:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262500:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262505:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262511:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262517:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262522:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262528:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262534:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262540:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262546:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262552:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262557:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262563:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262568:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262573:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262578:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262584:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262589:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262593:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262598:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262604:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262609:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262614:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262620:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262625:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262637:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262643:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262648:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262654:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262659:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262665:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262671:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262676:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262682:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262687:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262693:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262698:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262704:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262709:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262715:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.262721:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1782217048.263924:0:12809:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1782217048.263930:0:12809:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1782217048.271754:0:12809:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff88e67a3c56c0 - data ffff88e67f928948/ffff88e67a614400 00000020:01000000:1.0:1782217048.271913:0:12809:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff88e6501af000 - data ffff88e6803531b0/ffff88e68044c400 00000020:00000080:1.0:1782217048.272679:0:12809:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf210a9075089e823 00000020:00000080:1.0:1782217048.272687:0:12809:0:(genops.c:906:class_export_put()) final put ffff88e652790800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1782217048.272711:0:12809:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88e650a2a800 from MGS, refs=2 00000020:01000004:1.0:1782217048.272714:0:12809:0:(obd_mount.c:701:lustre_put_lsi()) put ffff88e650a2a800 2 00000020:01000004:1.0:1782217048.272717:0:12809:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff88e650a2a800 from MGS 00000020:00000080:1.0:1782217048.272741:0:12809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782217048.272748:0:12809:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1782217048.272750:0:12809:0:(genops.c:906:class_export_put()) final put ffff88e650a2c800/MGS 00000020:00000080:1.0:1782217048.272753:0:12809:0:(genops.c:865:class_export_destroy()) destroying export ffff88e650a2c800/MGS for MGS 00000020:01000000:1.0:1782217048.272759:0:12809:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1782217048.272815:0:12809:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1782217048.272829:0:12809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782217048.272834:0:12809:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1782217048.272841:0:12809:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff88e65057f800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1782217048.272846:0:12809:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff88e6745f0000) has exports, disconnecting them 00000020:00080000:1.0:1782217048.272851:0:12809:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff88e65057f800), last request at 1782216830 00000020:00000080:1.0:1782217048.272855:0:12809:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf210a9075089e8ee 00000020:00080000:1.0:1782217048.272863:0:12809:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff88e65057f800): rc 0 00000020:00000080:1.0:1782217048.272867:0:12809:0:(genops.c:906:class_export_put()) final put ffff88e65057f800/lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1782217048.273414:0:12809:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1782217048.273421:0:12809:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1782217048.273426:0:12809:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1782217048.273431:0:12809:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1782217048.273530:0:12809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782217048.273535:0:12809:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1782217048.273540:0:12809:0:(obd_mount.c:701:lustre_put_lsi()) put ffff88e650a2a800 1 00000020:00000080:1.0:1782217048.273544:0:12809:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf210a9075089e815 00000020:00000080:1.0:1782217048.273549:0:12809:0:(genops.c:906:class_export_put()) final put ffff88e6486ae000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1782217048.273553:0:12809:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1782217048.273557:0:12809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782217048.274693:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff88e652790800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1782217048.274713:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff88e65057f800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1782217048.274719:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff88e65057a800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1782217048.274728:0:38:0:(genops.c:906:class_export_put()) final put ffff88e652794000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1782217048.274731:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff88e652794000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1782217048.274736:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1782217048.274796:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff88e6486ae000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1782217048.275726:0:12809:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1782217048.275736:0:12809:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff88e6577e8000) has no exports 00000020:00000080:2.0:1782217048.307863:0:12809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782217048.307902:0:12809:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1782217048.307908:0:12809:0:(genops.c:906:class_export_put()) final put ffff88e650a28000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1782217048.307913:0:12809:0:(genops.c:865:class_export_destroy()) destroying export ffff88e650a28000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1782217048.307920:0:12809:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1782217048.308052:0:12809:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff88e650a2d800 00000020:01000000:2.0:1782217048.308083:0:12809:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1782217048.308087:0:12809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782217048.308091:0:12809:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1782217048.308105:0:12809:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff88e6484d99c0) has no exports 00000100:00100000:2.0:1782217048.308169:0:5785:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff88e657726200:5785] 2 exiting: rc = 0 00000100:00100000:2.0:1782217048.310981:0:5783:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff88e6447a5600:5783] 0 exiting: rc = 1 00000100:00100000:2.0:1782217048.311085:0:5784:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff88e64477c400:5784] 1 exiting: rc = 0 00000100:00100000:3.0:1782217048.311181:0:6855:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff88e67f0eba00:6855] 3 exiting: rc = 0 00000100:00100000:2.0:1782217048.311468:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311475:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311481:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311486:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311492:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311497:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311504:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311509:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311514:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311518:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311523:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311528:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311533:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311538:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311543:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311549:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311555:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311621:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311629:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311634:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311639:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311644:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311649:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311655:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311660:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311665:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311670:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311674:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311679:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311701:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311737:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311744:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311750:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311755:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311760:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311765:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311777:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311784:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311790:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311795:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311801:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311807:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311822:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311828:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311833:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311839:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311845:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311851:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311856:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311861:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311867:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311872:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311905:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311912:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311918:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311923:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311928:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311932:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311938:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311943:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311948:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311953:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311958:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.311965:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.319217:0:5786:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff88e657726600:5786] 0 exiting: rc = 1 00000100:00100000:1.0:1782217048.319732:0:5787:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff88e657726800:5787] 1 exiting: rc = 0 00000100:00100000:3.0:1782217048.322496:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.322507:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.322513:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.322635:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.322645:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.322654:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.322662:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.322672:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.322693:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.322707:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.322721:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.322728:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.322733:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.322738:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.322743:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.323285:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.323292:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.323296:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.323301:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.323305:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.323309:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.323313:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.323318:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.323322:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.323326:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.323330:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.323334:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.323338:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.323342:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.323346:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.323350:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.323353:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.323357:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.323361:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.323365:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.323369:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.323372:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.323376:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.323381:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.323385:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.323389:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.323394:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.323927:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.323945:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.323950:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.323957:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.323965:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.323973:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.323981:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.323988:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.323996:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.324003:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.324011:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.324018:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.324026:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.324033:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.324040:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.324047:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.324055:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.324072:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.324080:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.324085:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.324091:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.324097:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.325428:0:5788:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff88e64470a000:5788] 0 exiting: rc = 1 00000100:00100000:1.0:1782217048.325518:0:5789:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff88e64470ac00:5789] 1 exiting: rc = 0 00000100:00100000:3.0:1782217048.325610:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325618:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325631:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325650:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325657:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325663:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325673:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325678:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325683:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325691:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325696:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325700:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325705:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325710:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325724:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325747:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325754:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325760:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325767:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325773:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325780:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325787:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325793:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325799:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325807:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325814:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325823:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325845:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325853:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325860:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325866:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325872:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325906:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325915:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325920:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325926:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325933:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325939:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325945:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325967:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325975:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325981:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325989:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325993:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.325999:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.326005:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.326011:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.326017:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.326022:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.326034:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.326041:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.326095:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.326105:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.326112:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.326119:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.326130:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.326136:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.326142:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.326148:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.326155:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.326160:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.326166:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.326174:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.326199:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217048.338651:0:5790:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff88e64470a800:5790] 0 exiting: rc = 1 00000100:00100000:2.0:1782217048.338991:0:5791:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff88e6447a6c00:5791] 1 exiting: rc = 0 00000100:00100000:3.0:1782217048.339125:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339135:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339143:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339151:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339159:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339166:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339174:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339181:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339189:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339196:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339204:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339210:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339217:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339224:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339231:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339240:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339247:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339254:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339262:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339269:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339293:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339303:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339314:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339319:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339323:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339328:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339337:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339401:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339407:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339413:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339419:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339425:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339430:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339436:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339443:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339448:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339455:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339470:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339477:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339483:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339489:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339496:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339503:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339509:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339516:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339521:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339528:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339535:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339543:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339550:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339558:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339564:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339570:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339578:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339585:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339600:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339604:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339610:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339614:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339619:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339624:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339629:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339634:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.339639:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217048.341039:0:5793:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff88e6447a6600:5793] 1 exiting: rc = 0 00000100:00100000:2.0:1782217048.341372:0:5792:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff88e6447a6800:5792] 0 exiting: rc = 1 00000100:00100000:3.0:1782217048.341493:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341506:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341517:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341523:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341528:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341533:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341537:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341550:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341556:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341561:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341567:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341616:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341623:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341628:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341634:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341639:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341643:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341648:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341653:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341658:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341664:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341669:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341674:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341680:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341684:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341689:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341706:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341711:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341716:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341722:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341727:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341732:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341737:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341742:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341747:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341752:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341757:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341762:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341767:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341773:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341778:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341783:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341788:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341794:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341798:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341803:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341810:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341816:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341825:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341833:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341840:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341849:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341855:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341864:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.341871:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.342009:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.342015:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.342020:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.342025:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.342030:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.342035:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.342048:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.342052:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.342058:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217048.342619:0:5795:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff88e6447a6200:5795] 1 exiting: rc = 0 00000100:00100000:3.0:1782217048.342983:0:5794:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff88e6447a6400:5794] 0 exiting: rc = 1 00000100:00100000:2.0:1782217048.343090:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343098:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343103:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343109:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343113:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343118:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343123:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343128:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343134:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343139:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343145:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343150:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343157:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343162:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343168:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343172:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343178:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343182:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343187:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343193:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343197:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343202:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343209:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343214:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343218:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343223:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343227:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343232:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343237:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343253:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343258:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343275:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343280:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343285:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343290:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343296:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343301:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343306:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343311:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343316:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343320:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343325:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343330:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343335:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343340:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343345:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343350:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343355:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343360:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343365:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343369:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343374:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343379:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343385:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343391:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343397:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343404:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343411:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343418:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343424:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343431:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343440:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343447:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.343454:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217048.344467:0:5796:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff88e6484b4200:5796] 0 exiting: rc = 1 00000100:00100000:2.0:1782217048.344760:0:5798:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff88e6484b5e00:5798] 2 exiting: rc = 0 00000100:00100000:1.0:1782217048.345036:0:5797:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff88e6484b4a00:5797] 1 exiting: rc = 0 00000100:00100000:2.0:1782217048.345153:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.345178:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.345186:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.345191:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.345197:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.345203:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.345208:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.345214:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.345225:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.345230:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.345236:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.350473:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.350500:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.350508:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.350516:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.350524:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.350533:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.350543:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.350551:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.350559:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.350566:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.350575:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.350584:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.350592:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.352043:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.352097:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.352104:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.352110:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.352116:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.352123:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.352131:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.352137:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.352145:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.352153:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.352159:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.352165:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.352184:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.352190:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.352196:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.352203:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.352209:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.352216:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.352224:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.352235:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.352244:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.352253:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.352259:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.352264:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.352269:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.352692:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.352700:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.352705:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.352710:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.352715:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.352725:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.352729:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.352735:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.352740:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.352746:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.352751:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.352756:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.352761:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.352766:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217048.352771:0:12809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1782217048.365219:0:12809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782217048.365231:0:12809:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1782217048.365237:0:12809:0:(genops.c:906:class_export_put()) final put ffff88e65057d000/MDS_uuid 00000020:00000080:3.0:1782217048.365243:0:12809:0:(genops.c:865:class_export_destroy()) destroying export ffff88e65057d000/MDS_uuid for MDS 00000020:01000000:3.0:1782217048.365249:0:12809:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1782217048.365404:0:12809:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1782217048.663741:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1782217049.104356:0:6609:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1782217049.104366:0:6609:0:(genops.c:906:class_export_put()) final put ffff88e643536800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1782217049.104431:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff88e643536800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1782217049.104492:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff88e643534000 for lustre-OST0000 00010000:00010000:1.0:1782217049.686072:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217050.708105:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217051.092170:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789734001792:0@lo:400:kworker.0 00000400:00000100:0.0:1782217051.092223:0:3303:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1868789734001792 offset 0 length 224: 4 00000100:00100000:0.0:1782217051.092272:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782217051.092278:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1868789734001920:0@lo:400:kworker.0 00000400:00000100:0.0:1782217051.092298:0:3303:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868789734001920 offset 0 length 224: 4 00000100:00100000:3.0:1782217051.092430:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1868789734002048:0@lo:400:kworker.0 00000400:00000100:3.0:1782217051.092453:0:3301:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868789734002048 offset 0 length 224: 4 00000020:01000004:3.0:1782217051.150411:0:12961:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1782217051.167137:0:12961:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1782217051.167186:0:12961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3600/0xf210a9075089eb48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089eb4f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.167200:0:12961:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3600/0xf210a9075089eb48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089eb4f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.167207:0:12961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3600/0xf210a9075089eb48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf210a9075089eb4f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.167214:0:12961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3600/0xf210a9075089eb48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf210a9075089eb4f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.167343:0:12961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1782217051.167350:0:12961:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1782217051.167387:0:12961:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1782217051.167399:0:12961:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff88e64e2a2a00 x1868789734001920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217067 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217051.167418:0:12961:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1782217051.167423:0:12961:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1782217051.167448:0:12961:0:(import.c:65:import_set_state_nolock()) ffff88e6755cb000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1782217051.167502:0:3300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67420ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3300:1868789734002176:0@lo:39:umount.0 00000400:00000100:2.0:1782217051.167565:0:3300:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868789734002176 offset 0 length 224: 4 00000100:00100000:0.0:1782217051.167733:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1868789734001920:0@lo:400:kworker.0 00010000:00010000:1.0:1782217051.167796:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782217051.167804:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3600/0xf210a9075089eb48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf210a9075089eb4f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217051.167818:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67a2d3600 already unused, calling callback (ffffffffc1d2fc20) 10000000:00010000:1.0:1782217051.167822:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3600/0xf210a9075089eb48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf210a9075089eb4f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217051.167832:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3600/0xf210a9075089eb48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xf210a9075089eb4f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782217051.167839:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3600/0xf210a9075089eb48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xf210a9075089eb4f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782217051.167845:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1782217051.167847:0:5772:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1782217051.167849:0:5772:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1782217051.167983:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3600/0xf210a9075089eb48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf210a9075089eb4f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217051.167991:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1782217051.168037:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:526a4802-b871-4bcf-870f-067f11655366:3302:1868789734002304:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782217051.168087:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217051.168156:0:8301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734002304 00000100:00100000:0.0:1782217051.168163:0:8301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734002304 00000100:00100000:0.0:1782217051.168206:0:8301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782217051.168213:0:8301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67420c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0+-99:3302:x1868789734002304:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1782217051.168219:0:8301:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782217051 with bad export cookie 17442627205687011391 00010000:00010000:1.0:1782217051.169629:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3600/0xf210a9075089eb48 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf210a9075089eb4f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217051.169643:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e67a2d3600/0xf210a9075089eb48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf210a9075089eb4f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217051.172939:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217051.172946:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217051.172948:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217051.177637:0:8301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67420c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0+-99:3302:x1868789734002304:12345-0@lo:103:ldlm_bl.0 Request processed in 9413us (9539us total) trans 0 rc -107/-107 00000100:00100000:0.0:1782217051.177652:0:8301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1782217051.177749:0:3302:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.119@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1782217051.177755:0:3302:0:(import.c:65:import_set_state_nolock()) ffff88e650a29800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1782217051.177759:0:3302:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.119@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1782217051.186460:0:3302:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.119@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1782217051.186466:0:3302:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1782217051.186475:0:3302:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff88e64e2a0380 x1868789734001792/t0(0) o400->MGC192.168.203.119@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1782217067 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217051.186665:0:3302:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff88e664487b80 x1868789734002304/t0(0) o103->MGC192.168.203.119@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1782217067 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1782217051.186676:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1782217051.186679:0:3302:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1782217051.186681:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1782217051.186684:0:3302:0:(import.c:65:import_set_state_nolock()) ffff88e650a29800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782217051.186689:0:3302:0:(import.c:512:import_select_connection()) MGC192.168.203.119@tcp: connect to NID 0@lo last attempt 148 00000100:00080000:3.0:1782217051.186698:0:3302:0:(import.c:626:import_select_connection()) MGC192.168.203.119@tcp: import ffff88e650a29800 using connection 192.168.203.119@tcp/0@lo 00000100:00100000:2.0:1782217051.187062:0:3302:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88e64e2a0e00 x1868789734002432/t0(0) o250->MGC192.168.203.119@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782217051.187114:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:526a4802-b871-4bcf-870f-067f11655366:3302:1868789734002304:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782217051.187325:0:3300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:526a4802-b871-4bcf-870f-067f11655366:3300:1868789734002432:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:3.0:1782217051.187387:0:3300:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1868789734002432 offset 0 length 520: 4 00000100:00100000:0.0:1782217051.187646:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:526a4802-b871-4bcf-870f-067f11655366:3303:1868789734001792:0@lo:400:kworker.0 00010000:00010000:3.0:1782217051.733005:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217052.756986:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217053.780371:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217054.804693:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217055.831506:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782217056.212166:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) 526a4802-b871-4bcf-870f-067f11655366->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1782217056.212175:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) 526a4802-b871-4bcf-870f-067f11655366->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1782217056.212248:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782217056.212268:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67420d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1868789734002560:0@lo:400:kworker.0 00000400:00000100:3.0:1782217056.212317:0:3304:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868789734002560 offset 0 length 224: 4 00010000:00010000:1.0:1782217056.852064:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217057.878053:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217058.900043:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217059.924080:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217060.948043:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217061.332098:0:3300:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782217051/real 1782217051] req@ffff88e64e2a0e00 x1868789734002432/t0(0) o250->MGC192.168.203.119@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1782217061 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217061.332141:0:3300:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88e64e2a0e00 x1868789734002432/t0(0) o250->MGC192.168.203.119@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1782217061 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217061.332152:0:3300:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782217051/real 1782217051] req@ffff88e67420ea00 x1868789734002176/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782217061 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217061.332165:0:3300:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88e67420ea00 x1868789734002176/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782217061 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1782217061.332182:0:3300:0:(import.c:65:import_set_state_nolock()) ffff88e650a29800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782217061.332427:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) 526a4802-b871-4bcf-870f-067f11655366->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1782217061.332434:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1782217061.332437:0:8:0:(import.c:65:import_set_state_nolock()) ffff88e650a29800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782217061.332457:0:8:0:(import.c:512:import_select_connection()) MGC192.168.203.119@tcp: connect to NID 0@lo last attempt 370 00000100:00080000:0.0:1782217061.332463:0:8:0:(import.c:591:import_select_connection()) MGC192.168.203.119@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1782217061.332470:0:8:0:(import.c:626:import_select_connection()) MGC192.168.203.119@tcp: import ffff88e650a29800 using connection 192.168.203.119@tcp/0@lo 00000100:00100000:0.0:1782217061.332499:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88e67f79c700 x1868789734002688/t0(0) o250->MGC192.168.203.119@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782217061.332665:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782217061.332678:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f79f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1868789734002816:0@lo:400:kworker.0 00000400:00000100:2.0:1782217061.332721:0:3303:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868789734002816 offset 0 length 224: 4 00000100:00080000:3.0:1782217061.336907:0:3300:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1782217061.336918:0:3300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:526a4802-b871-4bcf-870f-067f11655366:3300:1868789734002432:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:3.0:1782217061.336929:0:3300:0:(import.c:65:import_set_state_nolock()) ffff88e6755cb000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1782217061.336951:0:3300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67420ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3300:1868789734002176:0@lo:39:umount.0 00000100:00100000:3.0:1782217061.337000:0:3300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f79c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:526a4802-b871-4bcf-870f-067f11655366:3300:1868789734002688:0@lo:250:kworker.0 00000400:00000100:3.0:1782217061.337050:0:3300:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1868789734002688 offset 0 length 520: 4 00000100:00080000:1.0:1782217061.337190:0:12961:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1782217061.337195:0:12961:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1782217061.337200:0:12961:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1782217061.338560:0:12961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e653161400/0xf210a9075089eb56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089eb5d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217061.338578:0:12961:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e653161400/0xf210a9075089eb56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089eb5d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217061.338585:0:12961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e653161400/0xf210a9075089eb56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf210a9075089eb5d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217061.338591:0:12961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.119@tcp lock: ffff88e653161400/0xf210a9075089eb56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf210a9075089eb5d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217061.338620:0:12961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782217061.338628:0:12961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e6738ae000/0xf210a9075089ed8d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ed94 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217061.338636:0:12961:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e6738ae000/0xf210a9075089ed8d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089ed94 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217061.338641:0:12961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e6738ae000/0xf210a9075089ed8d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf210a9075089ed94 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217061.338647:0:12961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.119@tcp lock: ffff88e6738ae000/0xf210a9075089ed8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf210a9075089ed94 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217061.338718:0:12961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1782217061.338723:0:12961:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1782217061.338752:0:12961:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1782217061.338756:0:12961:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1782217061.338761:0:12961:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782217061.338765:0:12961:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1782217061.338769:0:12961:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff88e675583380) has no exports 00000020:00080000:1.0:1782217061.338793:0:12961:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff88e675583380) has no exports 00010000:00010000:2.0:1782217061.342165:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782217061.342179:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e653161400/0xf210a9075089eb56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf210a9075089eb5d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217061.342191:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e653161400 already unused, calling callback (ffffffffc1d2fc20) 10000000:00010000:2.0:1782217061.342195:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e653161400/0xf210a9075089eb56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf210a9075089eb5d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217061.342206:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e653161400/0xf210a9075089eb56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf210a9075089eb5d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782217061.342213:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e653161400/0xf210a9075089eb56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf210a9075089eb5d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782217061.342220:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1782217061.342222:0:5772:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1782217061.342226:0:5772:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1782217061.342244:0:5772:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88e650a29800 00010000:00010000:2.0:1782217061.342248:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e653161400/0xf210a9075089eb56 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf210a9075089eb5d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217061.342254:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e653161400/0xf210a9075089eb56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf210a9075089eb5d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217061.342288:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782217061.342293:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e6738ae000/0xf210a9075089ed8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf210a9075089ed94 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217061.342299:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738ae000 already unused, calling callback (ffffffffc1d2fc20) 10000000:00010000:2.0:1782217061.342301:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e6738ae000/0xf210a9075089ed8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf210a9075089ed94 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217061.342308:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e6738ae000/0xf210a9075089ed8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf210a9075089ed94 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782217061.342313:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e6738ae000/0xf210a9075089ed8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf210a9075089ed94 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782217061.342318:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1782217061.342320:0:5772:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1782217061.342322:0:5772:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1782217061.342327:0:5772:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88e650a29800 00010000:00010000:2.0:1782217061.342330:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e6738ae000/0xf210a9075089ed8d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf210a9075089ed94 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217061.342337:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e6738ae000/0xf210a9075089ed8d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf210a9075089ed94 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217061.342346:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217061.342347:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217061.342349:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217061.344142:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1782217061.344817:0:12961:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff88e6455ee780 - data ffff88e65bd79798/ffff88e679fe0000 00000020:01000000:1.0:1782217061.345317:0:12961:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff88e6484199c0 - data ffff88e65be3fd80/ffff88e67f2ed800 00100000:10000000:1.0:1782217061.355013:0:12961:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1782217061.395449:0:12961:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf210a9075089e9a4 00000020:00000080:2.0:1782217061.395459:0:12961:0:(genops.c:906:class_export_put()) final put ffff88e6755c8800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1782217061.395543:0:12961:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88e673f4d000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1782217061.395548:0:12961:0:(obd_mount.c:701:lustre_put_lsi()) put ffff88e673f4d000 2 00000020:01000004:2.0:1782217061.395552:0:12961:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff88e673f4d000 from lustre-OST0000 00000020:00000080:2.0:1782217061.395576:0:12961:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782217061.395586:0:12961:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1782217061.395590:0:12961:0:(genops.c:906:class_export_put()) final put ffff88e6755c9800/lustre-OST0000_UUID 00000020:00000080:2.0:1782217061.395593:0:12961:0:(genops.c:865:class_export_destroy()) destroying export ffff88e6755c9800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1782217061.395600:0:12961:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1782217061.395642:0:12961:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1782217061.395646:0:12961:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1782217061.395651:0:12961:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782217061.395668:0:12961:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1782217061.395675:0:12961:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff88e6755cc000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1782217061.395682:0:12961:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff88e6577ecd40) has exports, disconnecting them 00000020:00080000:2.0:1782217061.395765:0:12961:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff88e6755cc000), last request at 1782216844 00000020:00000080:2.0:1782217061.395771:0:12961:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf210a9075089e9ce 00000020:00080000:2.0:1782217061.395784:0:12961:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff88e6755cc000): rc 0 00000020:00000080:2.0:1782217061.395789:0:12961:0:(genops.c:906:class_export_put()) final put ffff88e6755cc000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1782217061.396424:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff88e6755c8800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1782217061.397039:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff88e6755cc000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1782217061.398943:0:12961:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1782217061.398951:0:12961:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1782217061.398955:0:12961:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1782217061.398961:0:12961:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1782217061.399093:0:12961:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782217061.399102:0:12961:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1782217061.399108:0:12961:0:(obd_mount.c:701:lustre_put_lsi()) put ffff88e673f4d000 1 00000020:00000080:2.0:1782217061.399113:0:12961:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf210a9075089e91f 00000020:00000080:2.0:1782217061.399121:0:12961:0:(genops.c:906:class_export_put()) final put ffff88e6484d6000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1782217061.399125:0:12961:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1782217061.399129:0:12961:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782217061.399133:0:12961:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1782217061.399136:0:12961:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff88e6577eb380) has no exports 00000020:00000080:1.0:1782217061.399308:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff88e6755cb000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1782217061.399315:0:8:0:(genops.c:906:class_export_put()) final put ffff88e67f2af000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1782217061.399318:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff88e67f2af000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1782217061.399324:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1782217061.399370:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff88e6484d6000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1782217061.415643:0:12961:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782217061.415666:0:12961:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1782217061.415671:0:12961:0:(genops.c:906:class_export_put()) final put ffff88e673f4c000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1782217061.415675:0:12961:0:(genops.c:865:class_export_destroy()) destroying export ffff88e673f4c000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1782217061.415683:0:12961:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1782217061.416555:0:12961:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff88e673f4f800 00000020:02000400:1.0:1782217061.416606:0:12961:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1782217061.973043:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217062.999012:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217064.023102:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1782217064.196408:0:13114:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1782217064.216998:0:13114:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1782217064.217093:0:13114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e653161e00/0xf210a9075089eb2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089eb33 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217064.217106:0:13114:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e653161e00/0xf210a9075089eb2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089eb33 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217064.217125:0:13114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e653161e00/0xf210a9075089eb2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf210a9075089eb33 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217064.217131:0:13114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.119@tcp lock: ffff88e653161e00/0xf210a9075089eb2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf210a9075089eb33 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217064.217148:0:13114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1782217064.217154:0:13114:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1782217064.217175:0:13114:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1782217064.217185:0:13114:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff88e64e2a1500 x1868789734002048/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217067 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782217064.217205:0:13114:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff88e67420d880 x1868789734002560/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217072 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782217064.217219:0:13114:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff88e67f79f480 x1868789734002816/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217077 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782217064.217235:0:13114:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:1.0:1782217064.217269:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67420d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1868789734002560:0@lo:400:kworker.0 00000100:00100000:0.0:1782217064.217288:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f79f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1868789734002816:0@lo:400:kworker.0 00000100:00080000:1.0:1782217064.217300:0:13114:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1782217064.217323:0:13114:0:(import.c:65:import_set_state_nolock()) ffff88e679feb000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1782217064.217474:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1868789734002048:0@lo:400:kworker.0 00010000:00010000:3.0:1782217064.217722:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217064.217730:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e653161e00/0xf210a9075089eb2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf210a9075089eb33 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217064.217740:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e653161e00 already unused, calling callback (ffffffffc1d2fc20) 10000000:00010000:3.0:1782217064.217744:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e653161e00/0xf210a9075089eb2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf210a9075089eb33 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217064.217752:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e653161e00/0xf210a9075089eb2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf210a9075089eb33 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782217064.217759:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e653161e00/0xf210a9075089eb2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf210a9075089eb33 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782217064.217765:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1782217064.217768:0:5771:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1782217064.217770:0:5771:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1782217064.217782:0:5771:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88e650a29800 00010000:00010000:3.0:1782217064.217786:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e653161e00/0xf210a9075089eb2c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf210a9075089eb33 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217064.217792:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e653161e00/0xf210a9075089eb2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf210a9075089eb33 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217064.217803:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217064.217805:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217064.217806:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217064.217823:0:3300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3300:1868789734002944:0@lo:39:umount.0 00000400:00000100:3.0:1782217064.217868:0:3300:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868789734002944 offset 0 length 224: 4 00010000:00010000:0.0:1782217065.044597:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217066.068184:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782217066.453050:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) 526a4802-b871-4bcf-870f-067f11655366->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1782217066.453057:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) 526a4802-b871-4bcf-870f-067f11655366->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1782217067.092273:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217068.116559:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217069.140234:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217070.164142:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217071.188169:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782217071.577511:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) 526a4802-b871-4bcf-870f-067f11655366->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1782217071.577520:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) 526a4802-b871-4bcf-870f-067f11655366->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1782217072.214232:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217073.236260:0:11514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217074.260094:0:11515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217074.459265:0:3300:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782217064/real 1782217064] req@ffff88e664486300 x1868789734002944/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782217074 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217074.459310:0:3300:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88e664486300 x1868789734002944/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782217074 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1782217074.459331:0:3300:0:(import.c:65:import_set_state_nolock()) ffff88e679feb000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1782217074.459348:0:3300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3300:1868789734002944:0@lo:39:umount.0 00000100:00080000:1.0:1782217074.459824:0:13114:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1782217074.459834:0:13114:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1782217074.459843:0:13114:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1782217074.465268:0:13114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67fd07800/0xf210a9075089eb3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089eb41 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217074.467123:0:13114:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67fd07800/0xf210a9075089eb3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089eb41 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217074.467136:0:13114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67fd07800/0xf210a9075089eb3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf210a9075089eb41 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217074.467143:0:13114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.119@tcp lock: ffff88e67fd07800/0xf210a9075089eb3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf210a9075089eb41 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217074.467183:0:13114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782217074.467194:0:13114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67437a400/0xf210a9075089ed7f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ed86 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217074.467202:0:13114:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67437a400/0xf210a9075089ed7f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089ed86 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217074.467208:0:13114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67437a400/0xf210a9075089ed7f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf210a9075089ed86 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217074.467214:0:13114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.119@tcp lock: ffff88e67437a400/0xf210a9075089ed7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf210a9075089ed86 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217074.467239:0:13114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1782217074.467246:0:13114:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1782217074.467308:0:13114:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1782217074.467314:0:13114:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1782217074.467321:0:13114:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782217074.467329:0:13114:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1782217074.467334:0:13114:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff88e6577e99c0) has no exports 00000020:00080000:1.0:1782217074.467394:0:13114:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff88e6577e99c0) has no exports 00010000:00010000:3.0:1782217074.470320:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782217074.470342:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e67fd07800/0xf210a9075089eb3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf210a9075089eb41 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217074.470360:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07800 already unused, calling callback (ffffffffc1d2fc20) 10000000:00010000:3.0:1782217074.470365:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e67fd07800/0xf210a9075089eb3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf210a9075089eb41 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217074.470380:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e67fd07800/0xf210a9075089eb3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf210a9075089eb41 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782217074.470389:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e67fd07800/0xf210a9075089eb3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf210a9075089eb41 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782217074.470396:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1782217074.470399:0:5771:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1782217074.470403:0:5771:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1782217074.470431:0:5771:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88e650a29800 00010000:00010000:3.0:1782217074.470436:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e67fd07800/0xf210a9075089eb3a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf210a9075089eb41 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217074.470486:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e67fd07800/0xf210a9075089eb3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf210a9075089eb41 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217074.470507:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217074.470512:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e67437a400/0xf210a9075089ed7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf210a9075089ed86 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217074.470518:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437a400 already unused, calling callback (ffffffffc1d2fc20) 10000000:00010000:3.0:1782217074.470521:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e67437a400/0xf210a9075089ed7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf210a9075089ed86 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217074.470528:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e67437a400/0xf210a9075089ed7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf210a9075089ed86 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782217074.470535:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e67437a400/0xf210a9075089ed7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf210a9075089ed86 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782217074.470541:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1782217074.470543:0:5771:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1782217074.470546:0:5771:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1782217074.470551:0:5771:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88e650a29800 00010000:00010000:3.0:1782217074.470555:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e67437a400/0xf210a9075089ed7f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf210a9075089ed86 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217074.470561:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e67437a400/0xf210a9075089ed7f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf210a9075089ed86 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217074.470576:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217074.470578:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217074.470722:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217074.471738:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1782217074.472238:0:13114:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff88e6455ee4e0 - data ffff88e680349af8/ffff88e67f2b1400 00000020:01000000:1.0:1782217074.472454:0:13114:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff88e67f783240 - data ffff88e65bd0c438/ffff88e679fe0c00 00100000:10000000:1.0:1782217074.484640:0:13114:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1782217074.517862:0:13114:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf210a9075089ea30 00000020:00000080:3.0:1782217074.517925:0:13114:0:(genops.c:906:class_export_put()) final put ffff88e67f2ab000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1782217074.517939:0:13114:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88e64853e800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1782217074.517943:0:13114:0:(obd_mount.c:701:lustre_put_lsi()) put ffff88e64853e800 2 00000020:01000004:3.0:1782217074.517947:0:13114:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff88e64853e800 from lustre-OST0001 00000020:00000080:3.0:1782217074.517978:0:13114:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782217074.517990:0:13114:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1782217074.517994:0:13114:0:(genops.c:906:class_export_put()) final put ffff88e67f5de000/lustre-OST0001_UUID 00000020:00000080:3.0:1782217074.517997:0:13114:0:(genops.c:865:class_export_destroy()) destroying export ffff88e67f5de000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1782217074.518005:0:13114:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:0.0:1782217074.519284:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff88e67f2ab000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:3.0:1782217074.521682:0:13114:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import 526a4802-b871-4bcf-870f-067f11655366->MGS 00010000:00010000:3.0:1782217074.521705:0:13114:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e640030c00/0xf210a9075089e981 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf210a9075089e988 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782217074.521721:0:13114:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e640030c00/0xf210a9075089e981 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf210a9075089e988 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782217074.521728:0:13114:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1782217074.521731:0:13114:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1782217074.521735:0:13114:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1782217074.521750:0:13114:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88e650a29800 00010000:00010000:3.0:1782217074.521754:0:13114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e640030c00/0xf210a9075089e981 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf210a9075089e988 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217074.521773:0:13114:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e67437b400/0xf210a9075089eb80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf210a9075089eb87 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782217074.521780:0:13114:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e67437b400/0xf210a9075089eb80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf210a9075089eb87 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782217074.521786:0:13114:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1782217074.521802:0:13114:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1782217074.521805:0:13114:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1782217074.521831:0:13114:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88e650a29800 00010000:00010000:3.0:1782217074.521835:0:13114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e67437b400/0xf210a9075089eb80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf210a9075089eb87 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1782217074.521858:0:13114:0:(import.c:65:import_set_state_nolock()) ffff88e650a29800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1782217074.521863:0:13114:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1782217074.521865:0:13114:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1782217074.521868:0:13114:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1782217074.521915:0:13114:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1782217074.521925:0:13114:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff88e67f79c700 x1868789734002688/t0(0) o250->MGC192.168.203.119@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1782217076 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1782217074.521947:0:13114:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1782217074.521950:0:13114:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:0.0:1782217074.522905:0:3300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f79c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:526a4802-b871-4bcf-870f-067f11655366:3300:1868789734002688:0@lo:250:kworker.0 10000000:01000000:3.0:1782217074.522953:0:13114:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1782217074.522968:0:13114:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf210a9075089e831 00000020:00000080:3.0:1782217074.522977:0:13114:0:(genops.c:906:class_export_put()) final put ffff88e65057b000/526a4802-b871-4bcf-870f-067f11655366 00000020:01000000:3.0:1782217074.522997:0:13114:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.203.119@tcp (flags='') 00000020:00000080:3.0:1782217074.523005:0:13114:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782217074.523012:0:13114:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.119@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1782217074.523016:0:13114:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff88e6484dcd40) has no exports 00000020:00000080:0.0:1782217074.523190:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff88e65057b000/526a4802-b871-4bcf-870f-067f11655366 for MGC192.168.203.119@tcp 10000000:01000000:1.0:1782217074.524429:0:5780:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1782217074.536081:0:13114:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.119@tcp: client import never connected 00000100:00080000:3.0:1782217074.536090:0:13114:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1782217074.536094:0:13114:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1782217074.536099:0:13114:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1782217074.536101:0:13114:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1782217074.536182:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff88e650a29800 for MGC192.168.203.119@tcp 00000020:00000080:3.0:1782217074.536397:0:13114:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782217074.536408:0:13114:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.119@tcp (uuid 526a4802-b871-4bcf-870f-067f11655366) 00000020:00000080:3.0:1782217074.536414:0:13114:0:(genops.c:906:class_export_put()) final put ffff88e652790000/526a4802-b871-4bcf-870f-067f11655366 00000020:00000080:3.0:1782217074.536418:0:13114:0:(genops.c:865:class_export_destroy()) destroying export ffff88e652790000/526a4802-b871-4bcf-870f-067f11655366 for MGC192.168.203.119@tcp 00000020:01000000:3.0:1782217074.536431:0:13114:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.119@tcp (526a4802-b871-4bcf-870f-067f11655366) 00000020:01000000:3.0:1782217074.536707:0:13114:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1782217074.536713:0:13114:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782217074.536719:0:13114:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1782217074.536725:0:13114:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff88e679fe8000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1782217074.536730:0:13114:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff88e67a630000) has exports, disconnecting them 00000020:00080000:3.0:1782217074.536735:0:13114:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff88e679fe8000), last request at 1782216860 00000020:00000080:3.0:1782217074.536739:0:13114:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf210a9075089ea5a 00000020:00080000:3.0:1782217074.536756:0:13114:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff88e679fe8000): rc 0 00000020:00000080:3.0:1782217074.536761:0:13114:0:(genops.c:906:class_export_put()) final put ffff88e679fe8000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1782217074.536820:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff88e679fe8000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1782217074.550958:0:13114:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1782217074.550968:0:13114:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1782217074.550973:0:13114:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1782217074.550992:0:13114:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1782217074.551060:0:11514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:1.0:1782217074.551100:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff88e679feb000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1782217074.551216:0:11515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1782217074.551532:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:1.0:1782217074.551776:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:1.0:1782217074.551986:0:5767:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff88e68049b400:5767] 1 exiting: rc = 0 00000100:00100000:1.0:1782217074.552042:0:6593:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff88e67f2b5c00:6593] 2 exiting: rc = 0 00000100:00100000:0.0:1782217074.556130:0:5766:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff88e68049be00:5766] 0 exiting: rc = 1 00000100:00100000:1.0:1782217074.556228:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.556549:0:5768:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff88e68049a200:5768] 0 exiting: rc = 1 00000100:00100000:0.0:1782217074.556608:0:8301:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_005: service thread [ffff88e67fb52a00:8301] 5 exiting: rc = 0 00000100:00100000:0.0:1782217074.561024:0:5769:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff88e64477c200:5769] 1 exiting: rc = 0 00000100:00100000:0.0:1782217074.561154:0:8300:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff88e67fb53000:8300] 4 exiting: rc = 0 00000100:00100000:0.0:1782217074.561220:0:5770:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff88e64477ca00:5770] 2 exiting: rc = 0 00000100:00100000:3.0:1782217074.596057:0:8299:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff88e674384800:8299] 3 exiting: rc = 0 00000100:00100000:1.0:1782217074.596485:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596493:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596499:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596505:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596511:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596519:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596525:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596531:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596536:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596542:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596548:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596554:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596559:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596565:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596570:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596576:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596584:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596599:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596604:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596609:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596613:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596631:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596636:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596672:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596677:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596682:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596688:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596694:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596699:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596704:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596709:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596714:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596719:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596727:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596732:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596737:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596742:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596746:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596751:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596756:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596761:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596766:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596771:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596776:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596781:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596795:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596800:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596805:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596811:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596816:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596821:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596826:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596831:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596836:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596841:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596846:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596856:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596862:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596867:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596895:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596901:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596905:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596910:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.596916:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1782217074.599260:0:13114:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782217074.599273:0:13114:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1782217074.599279:0:13114:0:(genops.c:906:class_export_put()) final put ffff88e67f2c5000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1782217074.599284:0:13114:0:(genops.c:865:class_export_destroy()) destroying export ffff88e67f2c5000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1782217074.599294:0:13114:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1782217074.599346:0:13114:0:(obd_mount.c:701:lustre_put_lsi()) put ffff88e64853e800 1 00000020:00000080:1.0:1782217074.599351:0:13114:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf210a9075089e9ff 00000020:00000080:1.0:1782217074.599358:0:13114:0:(genops.c:906:class_export_put()) final put ffff88e6484ee000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1782217074.599410:0:13114:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1782217074.599415:0:13114:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782217074.599419:0:13114:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1782217074.599423:0:13114:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff88e674084d40) has no exports 00000020:00000080:0.0:1782217074.601268:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff88e6484ee000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1782217074.636939:0:13114:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782217074.636954:0:13114:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1782217074.636959:0:13114:0:(genops.c:906:class_export_put()) final put ffff88e648538800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1782217074.636964:0:13114:0:(genops.c:865:class_export_destroy()) destroying export ffff88e648538800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1782217074.636971:0:13114:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1782217074.637158:0:13114:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff88e64853f000 00000020:01000000:0.0:1782217074.637178:0:13114:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1782217074.637183:0:13114:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782217074.637187:0:13114:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1782217074.637191:0:13114:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff88e6755819c0) has no exports 00000020:00000080:0.0:1782217074.637216:0:13114:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782217074.637222:0:13114:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1782217074.637224:0:13114:0:(genops.c:906:class_export_put()) final put ffff88e6484d7800/OSS_uuid 00000020:00000080:0.0:1782217074.637226:0:13114:0:(genops.c:865:class_export_destroy()) destroying export ffff88e6484d7800/OSS_uuid for OSS 00000020:01000000:0.0:1782217074.637232:0:13114:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1782217074.638965:0:5779:0:(pinger.c:550:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1782217074.640634:0:6578:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff88e6444bca00:6578] 0 exiting: rc = 1 00000100:00100000:1.0:1782217074.640709:0:6580:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff88e67a3c8800:6580] 2 exiting: rc = 0 00000100:00100000:1.0:1782217074.640756:0:11864:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff88e674384e00:11864] 4 exiting: rc = 0 00000100:00100000:1.0:1782217074.640821:0:7991:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff88e67fee7400:7991] 3 exiting: rc = 0 00000100:00100000:1.0:1782217074.640868:0:6579:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff88e6444bd200:6579] 1 exiting: rc = 0 00000100:00100000:0.0:1782217074.641242:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.641251:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.641257:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.641265:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.641270:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.641275:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.641281:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.641286:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.641292:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.641297:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.641303:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.641308:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.641314:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.641320:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.641326:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.641347:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.641352:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.641357:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.641363:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.641368:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.641373:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.641378:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.641384:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.641389:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.641395:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.641400:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.641406:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.641410:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.641415:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.641420:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.641425:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.641429:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.641434:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.641439:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.641443:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.641448:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.641452:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.641457:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.642144:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.642150:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.642154:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.642160:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.642167:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.642172:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.642177:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.642197:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.642208:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.642213:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.642219:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.642225:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.642238:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.642244:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.642248:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.642253:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.642259:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.642264:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.642268:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.642272:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.642278:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.642284:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.642288:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.642292:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.642297:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.642302:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.643829:0:6581:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff88e67a3c8e00:6581] 0 exiting: rc = 1 00000100:00100000:3.0:1782217074.644140:0:6582:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff88e67a436800:6582] 1 exiting: rc = 0 00000100:00100000:0.0:1782217074.645953:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.645962:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.645968:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.645975:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.645980:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.645986:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.645997:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646008:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646218:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646227:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646235:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646242:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646249:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646256:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646263:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646271:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646279:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646286:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646294:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646301:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646308:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646327:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646335:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646342:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646349:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646357:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646364:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646372:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646380:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646387:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646395:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646403:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646410:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646418:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646425:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646432:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646440:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646448:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646579:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646592:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646600:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646607:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646616:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646626:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646633:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646640:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646648:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646655:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646663:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646670:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646676:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646684:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646692:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646699:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646707:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646715:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646732:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646740:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646749:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646756:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646764:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646771:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646779:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217074.646787:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.651828:0:6584:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff88e6444bcc00:6584] 1 exiting: rc = 0 00000100:00100000:3.0:1782217074.652157:0:6583:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff88e6444bc000:6583] 0 exiting: rc = 1 00000100:00100000:2.0:1782217074.652179:0:6585:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff88e6444bdc00:6585] 2 exiting: rc = 0 00000100:00100000:2.0:1782217074.652250:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.652258:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.652263:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.652269:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.652274:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.652279:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.652285:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.652290:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.652296:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.652301:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.652306:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.652312:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.652324:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.652331:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.652336:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.652342:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653162:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653171:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653177:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653183:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653189:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653195:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653200:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653218:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653224:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653230:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653236:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653242:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653247:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653252:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653258:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653264:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653270:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653276:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653284:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653290:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653309:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653316:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653321:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653327:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653337:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653343:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653348:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653354:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653360:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653367:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653375:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653383:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653390:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653396:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653404:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653411:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653417:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653423:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653429:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653435:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653442:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653447:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653461:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653471:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653477:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653482:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653487:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.653493:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217074.658266:0:6586:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff88e6444bc600:6586] 0 exiting: rc = 1 00000100:00100000:3.0:1782217074.658384:0:6587:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff88e6444bc400:6587] 1 exiting: rc = 0 00000100:00100000:1.0:1782217074.658479:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658487:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658492:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658497:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658502:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658508:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658529:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658536:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658541:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658546:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658551:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658557:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658562:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658567:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658571:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658576:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658581:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658586:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658591:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658597:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658624:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658630:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658635:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658655:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658662:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658668:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658673:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658678:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658683:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658688:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658692:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658697:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658702:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658707:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658712:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658716:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658721:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658726:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658730:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658736:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658741:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658752:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658757:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658762:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658766:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658771:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658776:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658781:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658786:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658791:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658796:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658800:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658805:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658810:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658814:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658819:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658824:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658828:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658834:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658839:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658843:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658848:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658852:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.658857:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.659592:0:6589:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff88e67a436000:6589] 1 exiting: rc = 0 00000100:00100000:3.0:1782217074.659869:0:6588:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff88e67a51fa00:6588] 0 exiting: rc = 1 00000100:00100000:1.0:1782217074.660034:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660050:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660058:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660064:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660070:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660076:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660081:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660087:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660093:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660099:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660116:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660133:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660139:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660149:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660155:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660161:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660168:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660174:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660181:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660187:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660192:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660198:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660218:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660225:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660231:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660237:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660243:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660248:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660253:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660259:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660264:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660270:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660275:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660281:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660302:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660314:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660319:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660325:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660332:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660337:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660342:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660349:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660355:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660361:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660367:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660372:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660398:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660405:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660412:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660418:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660425:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660431:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660437:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660443:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660449:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660455:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660462:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660468:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660489:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660498:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660503:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660509:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660514:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.660519:0:13114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1782217074.677843:0:13114:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1782217091.913542:0:13731:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg319-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1782217099.603212:0:14145:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1782217099.603217:0:14145:0:(obd_mount.c:917:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1782217099.603319:0:14145:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff88e652461000 00000020:01000004:0.0:1782217099.603334:0:14145:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1782217099.603341:0:14145:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1782217099.603355:0:14145:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff88e67fffb380) 00000020:00000080:0.0:1782217099.603369:0:14145:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1782217099.631375:0:14145:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1782217099.634303:0:14145:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1782217099.635009:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 353: rc = 0 00100000:10000000:2.0:1782217099.635119:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 353: rc = 0 00100000:10000000:2.0:1782217099.635224:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 353: rc = 0 00100000:10000000:2.0:1782217099.635328:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 353: rc = 0 00100000:10000000:2.0:1782217099.635793:0:14145:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1782217099.635872:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 353: rc = 0 00100000:10000000:2.0:1782217099.636053:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 353: rc = 0 00100000:10000000:2.0:1782217099.636314:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 355: rc = 0 00100000:10000000:2.0:1782217099.638489:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 514: rc = 0 00100000:10000000:2.0:1782217099.638721:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 514: rc = 0 00100000:10000000:2.0:1782217099.639280:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 498: rc = 0 00100000:10000000:2.0:1782217099.640059:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 498: rc = 0 00100000:10000000:2.0:1782217099.640391:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 498: rc = 0 00100000:10000000:2.0:1782217099.641114:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 498: rc = 0 00100000:10000000:2.0:1782217099.641509:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 498: rc = 0 00100000:10000000:2.0:1782217099.641964:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 498: rc = 0 00100000:10000000:2.0:1782217099.642237:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 498: rc = 0 00100000:10000000:2.0:1782217099.642947:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 498: rc = 0 00100000:10000000:2.0:1782217099.643195:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 498: rc = 0 00100000:10000000:2.0:1782217099.643792:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 498: rc = 0 00100000:10000000:2.0:1782217099.644104:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 498: rc = 0 00100000:10000000:2.0:1782217099.644502:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 498: rc = 0 00100000:10000000:2.0:1782217099.645215:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 509: rc = 0 00100000:10000000:3.0:1782217099.657400:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 509: rc = 0 00100000:10000000:3.0:1782217099.657829:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 509: rc = 0 00100000:10000000:3.0:1782217099.658113:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 509: rc = 0 00100000:10000000:3.0:1782217099.658370:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 509: rc = 0 00100000:10000000:3.0:1782217099.666213:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 509: rc = 0 00100000:10000000:3.0:1782217099.666546:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 509: rc = 0 00100000:10000000:3.0:1782217099.671204:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 509: rc = 0 00100000:10000000:3.0:1782217099.677576:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 509: rc = 0 00100000:10000000:3.0:1782217099.677923:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 509: rc = 0 00100000:10000000:3.0:1782217099.678573:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 509: rc = 0 00100000:10000000:3.0:1782217099.680246:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 509: rc = 0 00100000:10000000:3.0:1782217099.680911:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 509: rc = 0 00100000:10000000:3.0:1782217099.681318:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 509: rc = 0 00100000:10000000:3.0:1782217099.682891:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 509: rc = 0 00100000:10000000:3.0:1782217099.683833:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 509: rc = 0 00100000:10000000:3.0:1782217099.686599:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 509: rc = 0 00100000:10000000:3.0:1782217099.687374:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 509: rc = 0 00100000:10000000:3.0:1782217099.687640:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 509: rc = 0 00100000:10000000:3.0:1782217099.687958:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 509: rc = 0 00100000:10000000:3.0:1782217099.688227:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 509: rc = 0 00100000:10000000:3.0:1782217099.688470:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 509: rc = 0 00100000:10000000:3.0:1782217099.688725:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 509: rc = 0 00100000:10000000:3.0:1782217099.689007:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 509: rc = 0 00100000:10000000:3.0:1782217099.689266:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 509: rc = 0 00100000:10000000:3.0:1782217099.689502:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 509: rc = 0 00100000:10000000:2.0:1782217099.699513:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 509: rc = 0 00100000:10000000:2.0:1782217099.700840:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 509: rc = 0 00100000:10000000:2.0:1782217099.701161:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 509: rc = 0 00100000:10000000:2.0:1782217099.701403:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 509: rc = 0 00100000:10000000:2.0:1782217099.701676:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 509: rc = 0 00100000:10000000:2.0:1782217099.701985:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 509: rc = 0 00100000:10000000:2.0:1782217099.702324:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 519: rc = 0 00100000:10000000:2.0:1782217099.702824:0:14145:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1782217099.703002:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 515: rc = 0 00100000:10000000:2.0:1782217099.703189:0:14145:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1782217099.703257:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 515: rc = 0 00100000:10000000:2.0:1782217099.703453:0:14145:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1782217099.703525:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 515: rc = 0 00100000:10000000:2.0:1782217099.706738:0:14145:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1782217099.707256:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 494: rc = 0 00100000:10000000:2.0:1782217099.707587:0:14145:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1782217099.707659:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 494: rc = 0 00100000:10000000:2.0:1782217099.708543:0:14145:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1782217099.708617:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 494: rc = 0 00000020:00000080:2.0:1782217099.709624:0:14145:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1782217099.709632:0:14145:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1782217099.709641:0:14145:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf210a9075089fb24 00000020:01000004:2.0:1782217099.709648:0:14145:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1782217099.709654:0:14145:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1782217099.709667:0:14145:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88e652461000 from MGS 00000020:01000004:2.0:1782217099.709671:0:14145:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1782217099.709681:0:14145:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff88e6740819c0) 00000020:00000080:2.0:1782217099.709703:0:14145:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1782217099.709757:0:14145:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88e652461000 from MGS, refs=2 00080000:01000000:2.0:1782217099.709762:0:14145:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1782217099.709767:0:14145:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf210a9075089fb32 00000100:00100000:2.0:1782217099.710306:0:14145:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1782217099.710560:0:14145:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1782217099.710568:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1782217099.711538:0:14145:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1782217099.711546:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1782217099.712465:0:14145:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782217099.712728:0:14145:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1782217099.712783:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1782217099.713513:0:14145:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1782217099.713520:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1782217099.714729:0:14145:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1782217099.714817:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1782217099.715536:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217099.715540:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217099.715542:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217099.716314:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217099.716318:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217099.716320:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217099.723636:0:14145:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1782217099.731292:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1782217099.743297:0:14145:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1782217099.743315:0:14145:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1782217099.743318:0:14145:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1782217099.750155:0:14154:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1782217099.750498:0:14145:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1782217099.750613:0:14145:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1782217099.751639:0:14145:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1782217099.752640:0:14145:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782217099.753552:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1782217099.753561:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1782217099.754557:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1782217099.754566:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1782217099.758235:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1782217099.758251:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1782217099.772538:0:14145:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1782217099.772562:0:14145:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.203.119@tcp' 00000020:01000004:3.0:1782217099.772564:0:14145:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1782217099.772593:0:14145:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.203.119@tcp (typ=mgc) 00000020:00000080:3.0:1782217099.772611:0:14145:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.119@tcp (ffff88e67a633380) 00000020:00000080:3.0:1782217099.772627:0:14145:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1782217099.772718:0:14145:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88e542dc5000@MGC192.168.203.119@tcp: add connection 192.168.203.119@tcp at head 00010000:00010000:3.0:1782217099.772867:0:14145:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.119@tcp-0 is initialized 00000040:01000000:3.0:1782217099.772873:0:14145:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.119@tcp ctxt 1 is initialized 00000100:00080000:2.0:1782217099.773569:0:14158:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1782217099.776456:0:14160:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1782217099.777964:0:14145:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.119@tcp (uuid 713996b4-9a75-4cc4-875d-de8926ad5952) 00000020:00000080:3.0:1782217099.777984:0:14145:0:(genops.c:1406:class_connect()) connect: client 713996b4-9a75-4cc4-875d-de8926ad5952, cookie 0xf210a9075089fb40 00000100:00080000:3.0:1782217099.777996:0:14145:0:(import.c:512:import_select_connection()) MGC192.168.203.119@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782217099.778002:0:14145:0:(import.c:626:import_select_connection()) MGC192.168.203.119@tcp: import ffff88e542dc5000 using connection 192.168.203.119@tcp/0@lo 00000100:00100000:3.0:1782217099.778032:0:14145:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88e67420ea00 x1868789734003072/t0(0) o250->MGC192.168.203.119@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782217099.778578:0:14145:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import 713996b4-9a75-4cc4-875d-de8926ad5952->MGS 00000020:01000004:3.0:1782217099.778599:0:14145:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1782217099.778604:0:14145:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1782217099.778617:0:14145:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff88e67a634d40) 00000020:00000080:3.0:1782217099.778629:0:14145:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1782217099.779225:0:3300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67420ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:713996b4-9a75-4cc4-875d-de8926ad5952:3300:1868789734003072:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1782217099.779289:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217099.780493:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734003072 00000100:00100000:0.0:1782217099.780506:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734003072 00000100:00100000:0.0:1782217099.780539:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782217099.780547:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67aaa6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3300:x1868789734003072:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1782217099.780572:0:14155:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 713996b4-9a75-4cc4-875d-de8926ad5952@0@lo t0 exp 0000000000000000 cur 418 last 0 00000020:00000080:0.0:1782217099.780597:0:14155:0:(genops.c:1406:class_connect()) connect: client 713996b4-9a75-4cc4-875d-de8926ad5952, cookie 0xf210a9075089fb4e 00000100:00080000:0.0:1782217099.780730:0:14155:0:(import.c:65:import_set_state_nolock()) ffff88e652466000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782217099.780796:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67aaa6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+5:3300:x1868789734003072:12345-0@lo:250:mount.lustre.0 Request processed in 247us (1506us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217099.780804:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782217099.780847:0:3300:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.203.119@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1782217099.780856:0:3300:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.203.119@tcp: connect to target with instance 0 00000100:00080000:0.0:1782217099.780863:0:3300:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.203.119@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1782217099.780866:0:3300:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1782217099.780870:0:3300:0:(import.c:65:import_set_state_nolock()) ffff88e542dc5000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1782217099.780910:0:3300:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1782217099.780922:0:3300:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1782217099.780928:0:3300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67420ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:713996b4-9a75-4cc4-875d-de8926ad5952:3300:1868789734003072:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1782217099.802604:0:14145:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782217099.803340:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1782217099.803347:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1782217099.807262:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1782217099.807275:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1782217099.807739:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1782217099.807746:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1782217099.808786:0:14145:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782217099.809242:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1782217099.809247:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1782217099.809795:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1782217099.809802:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1782217099.853276:0:14145:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782217099.853711:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1782217099.853719:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1782217099.857248:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1782217099.857268:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1782217099.858266:0:14145:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782217099.858770:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1782217099.858790:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1782217099.859696:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1782217099.859704:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1782217099.861034:0:14145:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782217099.861195:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1782217099.861200:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1782217099.863345:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1782217099.863355:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1782217099.864825:0:14145:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782217099.866154:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1782217099.866161:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1782217099.867093:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1782217099.867101:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1782217099.884387:0:14145:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782217099.884562:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1782217099.884568:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1782217099.887481:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1782217099.887498:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1782217099.891109:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1782217099.891125:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1782217099.891828:0:14145:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1782217099.891848:0:14145:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1782217099.891853:0:14145:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.119@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1782217099.892002:0:14145:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.119@tcp ctxt 0 is initialized 00000020:01000004:0.0:1782217099.892031:0:14145:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.119@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1782217099.892036:0:14145:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1782217099.892038:0:14145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1782217099.892039:0:14145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782217099.892040:0:14145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782217099.892041:0:14145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782217099.892043:0:14145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782217099.892044:0:14145:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782217099.892045:0:14145:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1782217099.892248:0:14145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782217099.892250:0:14145:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782217099.892253:0:14145:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1782217099.892255:0:14145:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782217099.892257:0:14145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1782217099.892258:0:14145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782217099.892259:0:14145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782217099.892260:0:14145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782217099.892262:0:14145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782217099.892263:0:14145:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782217099.892264:0:14145:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1782217099.892265:0:14145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782217099.892266:0:14145:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1782217099.892353:0:14145:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1782217099.892372:0:14145:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664487100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14145:1868789734003200:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1782217099.892433:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217099.892482:0:14145:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6485f99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782217099.892578:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734003200 00000100:00100000:3.0:1782217099.892585:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734003200 00000100:00100000:3.0:1782217099.892654:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782217099.892663:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67aaa4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+5:14145:x1868789734003200:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1782217099.892716:0:14157:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1782217099.892722:0:14157:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1782217099.892726:0:14157:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1782217099.893057:0:14178:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1782217099.893347:0:14157:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1782217099.894296:0:14179:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1782217099.894302:0:14179:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1782217099.894304:0:14179:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1782217099.894334:0:14179:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1782217099.894553:0:14157:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1782217099.894561:0:14157:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1782217099.899176:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67aaa4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+5:14145:x1868789734003200:12345-0@lo:253:mount.lustre.0 Request processed in 6505us (6735us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217099.899245:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782217099.899324:0:14145:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664487100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14145:1868789734003200:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1782217099.899338:0:14145:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1782217099.899341:0:14145:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782217099.899343:0:14145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1782217099.899344:0:14145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782217099.899345:0:14145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782217099.899346:0:14145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782217099.899348:0:14145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782217099.899349:0:14145:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782217099.899351:0:14145:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1782217099.899353:0:14145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782217099.899354:0:14145:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1782217099.899371:0:14145:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88e652461000 from lustre-MDT0000 10000000:01000000:1.0:1782217099.899393:0:14145:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1782217099.899395:0:14145:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1782217099.899400:0:14145:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff88e67a633380 10000000:01000000:1.0:1782217099.899404:0:14145:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782217099.899410:0:14145:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff88e67a633380 from 1 10000000:01000000:1.0:1782217099.899413:0:14145:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1782217099.899445:0:14145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67fd06c00/0xf210a9075089fb55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217099.899455:0:14145:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e67fd06c00/0xf210a9075089fb55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217099.899465:0:14145:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e67fd06c00/0xf210a9075089fb55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217099.899482:0:14145:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664487100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14145:1868789734003328:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782217099.899514:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217099.899581:0:14145:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6485f90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782217099.899622:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734003328 00000100:00100000:0.0:1782217099.899629:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734003328 00000100:00100000:0.0:1782217099.899704:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782217099.899714:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67aaa5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+5:14145:x1868789734003328:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782217099.899726:0:14156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217099.899744:0:14156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e67437b400/0xf210a9075089fb5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089fb55 expref: -99 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217099.899765:0:14156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e67437b400/0xf210a9075089fb5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089fb55 expref: 6 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217099.899775:0:14156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e67437b400/0xf210a9075089fb5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089fb55 expref: 6 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217099.899784:0:14156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437b400, rc 0) 00000100:00100000:0.0:1782217099.899818:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67aaa5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+6:14145:x1868789734003328:12345-0@lo:101:mount.lustre.0 Request processed in 106us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217099.899824:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782217099.899873:0:14145:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664487100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14145:1868789734003328:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782217099.899909:0:14145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e67fd06c00/0xf210a9075089fb55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fb5c expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217099.899917:0:14145:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e67fd06c00/0xf210a9075089fb55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089fb5c expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217099.899955:0:14145:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664487100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14145:1868789734003456:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782217099.899977:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217099.900127:0:14145:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6485f90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782217099.900180:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734003456 00000100:00100000:2.0:1782217099.900239:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734003456 00000100:00100000:2.0:1782217099.900260:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782217099.900265:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67aaa7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+6:14145:x1868789734003456:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782217099.900483:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67aaa7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+6:14145:x1868789734003456:12345-0@lo:501:mount.lustre.0 Request processed in 216us (504us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782217099.900489:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782217099.900579:0:14145:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664487100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14145:1868789734003456:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1782217099.900600:0:14145:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1782217099.900645:0:14145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67fd06c00/0xf210a9075089fb55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fb5c expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217099.900654:0:14145:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e67fd06c00/0xf210a9075089fb55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fb5c expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782217099.900661:0:14145:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88e652461000 10000000:01000000:1.0:1782217099.900664:0:14145:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1782217099.900668:0:14145:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff88e652461000 10000000:01000000:1.0:1782217099.900670:0:14145:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1782217099.900673:0:14145:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff88e652461000 from 1 10000000:01000000:1.0:1782217099.900675:0:14145:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1782217099.900707:0:14145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67fd07a00/0xf210a9075089fb63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217099.900715:0:14145:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e67fd07a00/0xf210a9075089fb63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217099.900728:0:14145:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e67fd07a00/0xf210a9075089fb63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217099.900741:0:14145:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664487100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14145:1868789734003584:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782217099.900763:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217099.900782:0:14145:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6485f90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782217099.900823:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734003584 00000100:00100000:2.0:1782217099.900827:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734003584 00000100:00100000:2.0:1782217099.900852:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782217099.900858:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67aaa5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+6:14145:x1868789734003584:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782217099.900870:0:14155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217099.900907:0:14155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e6738ae200/0xf210a9075089fb6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089fb63 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217099.900921:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e6738ae200/0xf210a9075089fb6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089fb63 expref: 7 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217099.900930:0:14155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e6738ae200/0xf210a9075089fb6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089fb63 expref: 7 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217099.900937:0:14155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738ae200, rc 0) 00000100:00100000:2.0:1782217099.900960:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67aaa5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+7:14145:x1868789734003584:12345-0@lo:101:mount.lustre.0 Request processed in 102us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217099.900965:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782217099.901058:0:14145:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664487100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14145:1868789734003584:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782217099.901068:0:14145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e67fd07a00/0xf210a9075089fb63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fb6a expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217099.901076:0:14145:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e67fd07a00/0xf210a9075089fb63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089fb6a expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782217099.901086:0:14145:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1782217099.901296:0:14145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67fd07a00/0xf210a9075089fb63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fb6a expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217099.901305:0:14145:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e67fd07a00/0xf210a9075089fb63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fb6a expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782217099.901311:0:14145:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1782217099.901314:0:14145:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782217099.901319:0:14145:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff88e652461000 10000000:01000000:1.0:1782217099.901321:0:14145:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1782217099.901324:0:14145:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1782217099.901326:0:14145:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1782217099.901339:0:14145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67fd07e00/0xf210a9075089fb71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217099.901351:0:14145:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e67fd07e00/0xf210a9075089fb71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217099.901359:0:14145:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e67fd07e00/0xf210a9075089fb71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217099.901372:0:14145:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664487100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14145:1868789734003712:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782217099.901394:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217099.901418:0:14145:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6485f90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782217099.901463:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734003712 00000100:00100000:2.0:1782217099.901467:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734003712 00000100:00100000:2.0:1782217099.901492:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782217099.901497:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67aaa5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+7:14145:x1868789734003712:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782217099.901504:0:14155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217099.901511:0:14155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e6738ae400/0xf210a9075089fb78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089fb71 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217099.901524:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e6738ae400/0xf210a9075089fb78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089fb71 expref: 8 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217099.901532:0:14155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e6738ae400/0xf210a9075089fb78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089fb71 expref: 8 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217099.901539:0:14155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738ae400, rc 0) 00000100:00100000:2.0:1782217099.901578:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67aaa5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+8:14145:x1868789734003712:12345-0@lo:101:mount.lustre.0 Request processed in 80us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217099.901584:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782217099.901644:0:14145:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664487100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14145:1868789734003712:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782217099.901654:0:14145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e67fd07e00/0xf210a9075089fb71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fb78 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217099.901661:0:14145:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e67fd07e00/0xf210a9075089fb71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089fb78 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217099.901707:0:14145:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67420dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14145:1868789734003840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782217099.901730:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217099.901750:0:14145:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e657794600 going to sleep for 11 seconds 00000100:00100000:1.0:1782217099.901795:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734003840 00000100:00100000:1.0:1782217099.901798:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734003840 00000100:00100000:1.0:1782217099.901824:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782217099.901829:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67aaa7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+8:14145:x1868789734003840:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782217099.902127:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67aaa7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+9:14145:x1868789734003840:12345-0@lo:501:mount.lustre.0 Request processed in 297us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217099.902134:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782217099.902229:0:14145:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67420dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14145:1868789734003840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782217099.902254:0:14145:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67420dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14145:1868789734003968:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782217099.902286:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217099.902303:0:14145:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e657794600 going to sleep for 11 seconds 00000100:00100000:1.0:1782217099.902456:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734003968 00000100:00100000:1.0:1782217099.902461:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734003968 00000100:00100000:1.0:1782217099.902488:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782217099.902494:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67aaa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+9:14145:x1868789734003968:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782217099.902753:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67aaa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+9:14145:x1868789734003968:12345-0@lo:503:mount.lustre.0 Request processed in 259us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217099.902760:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782217099.902862:0:14145:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67420dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14145:1868789734003968:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782217099.903288:0:14180:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67420dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:713996b4-9a75-4cc4-875d-de8926ad5952:14180:1868789734004096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782217099.903321:0:14180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217099.903376:0:14180:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e657794f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782217099.903400:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734004096 00000100:00100000:1.0:1782217099.903404:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734004096 00000100:00100000:1.0:1782217099.903460:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782217099.903467:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f2b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+9:14180:x1868789734004096:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782217099.903672:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f2b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+9:14180:x1868789734004096:12345-0@lo:502:llog_process_th.0 Request processed in 205us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217099.903679:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782217099.903741:0:14180:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67420dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:713996b4-9a75-4cc4-875d-de8926ad5952:14180:1868789734004096:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782217099.903767:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782217099.903776:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782217099.903779:0:14180:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1782217099.903783:0:14180:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1782217099.903786:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782217099.903799:0:14180:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff88e67a6319c0) 00000020:00000080:3.0:1782217099.903813:0:14180:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1782217099.903817:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1782217099.903911:0:14180:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:3.0:1782217099.903918:0:14180:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf210a9075089fb86 00000020:00000080:3.0:1782217099.904109:0:14180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1782217099.904112:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782217099.904116:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782217099.904117:0:14180:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1782217099.904120:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782217099.904123:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782217099.904124:0:14180:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1782217099.904127:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782217099.904134:0:14180:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff88e67a630000) 00000020:00000080:3.0:1782217099.904142:0:14180:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1782217099.904146:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1782217099.904147:0:14180:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1782217099.904150:0:14180:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1782217099.904155:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1782217099.904197:0:14180:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88e652461000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1782217099.904216:0:14180:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff88e651fc0000) 00000020:00000080:3.0:1782217099.904225:0:14180:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1782217099.904273:0:14180:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1782217099.904277:0:14180:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf210a9075089fb9b 00000020:00000080:3.0:1782217099.904358:0:14180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1782217099.904363:0:14180:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1782217099.904366:0:14180:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf210a9075089fba2 00080000:01000000:3.0:1782217099.904375:0:14180:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:3.0:1782217099.904378:0:14180:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf210a9075089fba9 00010000:00010000:3.0:1782217100.000109:0:14180:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1782217100.000550:0:14180:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:3.0:1782217100.001678:0:14180:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1782217100.002583:0:14180:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff88e651fc3380) 00000020:00000080:3.0:1782217100.002602:0:14180:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1782217100.003226:0:14180:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:3.0:1782217100.003234:0:14180:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf210a9075089fbb7 00000020:00000080:1.0:1782217100.004491:0:14180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1782217100.015559:0:14180:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf210a9075089fbbe 00000020:00000080:1.0:1782217100.016221:0:14180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1782217100.016233:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782217100.016239:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782217100.016241:0:14180:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1782217100.016244:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782217100.016250:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782217100.016252:0:14180:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1782217100.016256:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1782217100.016286:0:14180:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1782217100.016297:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782217100.016300:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782217100.016302:0:14180:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1782217100.016305:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1782217100.016307:0:14180:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1782217100.016308:0:14180:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782217100.016309:0:14180:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782217100.016311:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1782217100.016313:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782217100.016314:0:14180:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1782217100.016317:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1782217100.016320:0:14180:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1782217100.016323:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782217100.016324:0:14180:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1782217100.016327:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1782217100.016333:0:14180:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.119@tcp to nid 0x20000c0a8cb77 (192.168.203.119@tcp) 00000020:01000000:1.0:1782217100.016356:0:14180:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1782217100.016379:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782217100.016393:0:14180:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff88e6745f3380) 00000020:00000080:1.0:1782217100.016405:0:14180:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1782217100.016410:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1782217100.016468:0:14180:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1782217100.016474:0:14180:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:1.0:1782217100.016480:0:14180:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf210a9075089fbcc 00010000:00080000:1.0:1782217100.016508:0:14180:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88e67418a000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.119@tcp at head 00010000:00010000:1.0:1782217100.016737:0:14180:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1782217100.017119:0:14180:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1782217100.017169:0:14180:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1782217100.019579:0:14180:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782217100.019721:0:14180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1782217100.020130:0:14180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1782217100.021000:0:14184:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1782217100.021006:0:14184:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1782217100.021835:0:14180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1782217100.021845:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1782217100.021873:0:14180:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1782217100.022149:0:14180:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf210a9075089fbd3 00000100:00080000:3.0:1782217100.022162:0:14180:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782217100.022168:0:14180:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff88e67418a000 using connection 192.168.203.119@tcp/0@lo 00000100:00100000:3.0:1782217100.022286:0:14180:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88e67420dc00 x1868789734004224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782217100.022311:0:14180:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1782217100.022457:0:3300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67420dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1868789734004224:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1782217100.022510:0:3300:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868789734004224 offset 0 length 520: 4 00000020:01000000:3.0:1782217100.022552:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782217100.022556:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782217100.022558:0:14180:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1782217100.022562:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1782217100.022565:0:14180:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1782217100.022566:0:14180:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1782217100.022568:0:14180:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1782217100.022570:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1782217100.022573:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782217100.022574:0:14180:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1782217100.022577:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1782217100.022587:0:14180:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1782217100.022590:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782217100.022592:0:14180:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1782217100.022595:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1782217100.022599:0:14180:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.119@tcp to nid 0x20000c0a8cb77 (192.168.203.119@tcp) 00000020:01000000:3.0:1782217100.022616:0:14180:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1782217100.022618:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782217100.022628:0:14180:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff88e651fc4d40) 00000020:00000080:3.0:1782217100.022640:0:14180:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1782217100.022643:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1782217100.022717:0:14180:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1782217100.022723:0:14180:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:3.0:1782217100.022729:0:14180:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf210a9075089fbe1 00010000:00080000:3.0:1782217100.022757:0:14180:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88e650a33000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.119@tcp at head 00000100:00100000:2.0:1782217100.022832:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782217100.022843:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:713996b4-9a75-4cc4-875d-de8926ad5952:3302:1868789734004352:0@lo:400:kworker.0 00010000:00010000:3.0:1782217100.023002:0:14180:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000100:00100000:2.0:1782217100.023114:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:3.0:1782217100.023171:0:14180:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1782217100.023188:0:14180:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1782217100.023230:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734004352 00000100:00100000:2.0:1782217100.023237:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734004352 00000100:00100000:2.0:1782217100.023284:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782217100.023294:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f2b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+9:3302:x1868789734004352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217100.023343:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f2b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+9:3302:x1868789734004352:12345-0@lo:400:kworker.0 Request processed in 51us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217100.023351:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782217100.023398:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:713996b4-9a75-4cc4-875d-de8926ad5952:3302:1868789734004352:0@lo:400:kworker.0 00000040:00080000:3.0:1782217100.023832:0:14180:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782217100.023913:0:14180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1782217100.023984:0:14180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1782217100.025915:0:14186:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1782217100.025933:0:14186:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1782217100.027382:0:14180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1782217100.027394:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1782217100.027489:0:14180:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1782217100.027509:0:14180:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf210a9075089fbe8 00000100:00080000:1.0:1782217100.027520:0:14180:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782217100.027526:0:14180:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88e650a33000 using connection 192.168.203.119@tcp/0@lo 00000100:00100000:1.0:1782217100.027556:0:14180:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88e664486680 x1868789734004480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782217100.027611:0:3300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1868789734004480:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1782217100.027673:0:3300:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868789734004480 offset 0 length 520: 4 00000100:00080000:1.0:1782217100.027734:0:14180:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1782217100.027787:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782217100.027792:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782217100.027794:0:14180:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1782217100.027797:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782217100.027802:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782217100.027803:0:14180:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782217100.027806:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782217100.027808:0:14180:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1782217100.027816:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782217100.027818:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782217100.027820:0:14180:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1782217100.027822:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782217100.027825:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782217100.027826:0:14180:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1782217100.027830:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1782217100.027857:0:14180:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664484380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:713996b4-9a75-4cc4-875d-de8926ad5952:14180:1868789734004608:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782217100.027919:0:14180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217100.027938:0:14180:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6485f9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782217100.027957:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734004608 00000100:00100000:1.0:1782217100.027962:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734004608 00000100:00100000:1.0:1782217100.027992:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782217100.027999:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f2b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+9:14180:x1868789734004608:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782217100.028233:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f2b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+9:14180:x1868789734004608:12345-0@lo:502:llog_process_th.0 Request processed in 234us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217100.028241:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782217100.028301:0:14180:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664484380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:713996b4-9a75-4cc4-875d-de8926ad5952:14180:1868789734004608:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782217100.028324:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782217100.028328:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782217100.028329:0:14180:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1782217100.028333:0:14180:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1782217100.029114:0:14145:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1782217100.029133:0:14145:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1782217100.029157:0:14145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67fd07e00/0xf210a9075089fb71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fb78 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217100.029168:0:14145:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e67fd07e00/0xf210a9075089fb71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fb78 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782217100.029300:0:14145:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff88e652461000 from 1 10000000:01000000:1.0:1782217100.029302:0:14145:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782217100.029331:0:14145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67fd07600/0xf210a9075089fbef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217100.029339:0:14145:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e67fd07600/0xf210a9075089fbef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217100.029348:0:14145:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e67fd07600/0xf210a9075089fbef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217100.029363:0:14145:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664484380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14145:1868789734004736:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782217100.029401:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217100.029474:0:14145:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6485f9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782217100.029650:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734004736 00000100:00100000:2.0:1782217100.029656:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734004736 00000100:00100000:2.0:1782217100.029727:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782217100.029736:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f2b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+9:14145:x1868789734004736:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782217100.029746:0:14157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217100.029757:0:14157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e6738ae800/0xf210a9075089fbf6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089fbef expref: -99 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217100.029777:0:14157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e6738ae800/0xf210a9075089fbf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089fbef expref: 10 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217100.029787:0:14157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e6738ae800/0xf210a9075089fbf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089fbef expref: 10 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217100.029810:0:14157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738ae800, rc 0) 00000100:00100000:2.0:1782217100.029851:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f2b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+10:14145:x1868789734004736:12345-0@lo:101:mount.lustre.0 Request processed in 117us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217100.029868:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782217100.029963:0:14145:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664484380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14145:1868789734004736:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782217100.029976:0:14145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e67fd07600/0xf210a9075089fbef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fbf6 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217100.029984:0:14145:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e67fd07600/0xf210a9075089fbef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089fbf6 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217100.030504:0:14145:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f79dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14145:1868789734004864:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1782217100.030546:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217100.030567:0:14145:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e680504240 going to sleep for 11 seconds 00000100:00100000:2.0:1782217100.030621:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734004864 00000100:00100000:2.0:1782217100.030627:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734004864 00000100:00100000:2.0:1782217100.030666:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782217100.030674:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f2b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+10:14145:x1868789734004864:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1782217100.030698:0:14157:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1782217100.030704:0:14157:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1782217100.031252:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f2b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+10:14145:x1868789734004864:12345-0@lo:256:mount.lustre.0 Request processed in 578us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217100.031261:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782217100.031381:0:14145:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f79dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14145:1868789734004864:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1782217100.032184:0:14145:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782217100.032208:0:14145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67fd07600/0xf210a9075089fbef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fbf6 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217100.032218:0:14145:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e67fd07600/0xf210a9075089fbef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fbf6 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782217100.032226:0:14145:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff88e652461000 from 1 10000000:01000000:0.0:1782217100.032228:0:14145:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782217100.032257:0:14145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67437a400/0xf210a9075089fbfd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217100.032266:0:14145:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e67437a400/0xf210a9075089fbfd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217100.032276:0:14145:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e67437a400/0xf210a9075089fbfd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217100.032474:0:14145:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f79dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14145:1868789734004992:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1782217100.032509:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217100.032570:0:14145:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e680504240 going to sleep for 11 seconds 00000100:00100000:3.0:1782217100.032610:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734004992 00000100:00100000:3.0:1782217100.032616:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734004992 00000100:00100000:3.0:1782217100.032700:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782217100.032710:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f2b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+10:14145:x1868789734004992:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782217100.032720:0:14155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217100.032742:0:14155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e682170400/0xf210a9075089fc04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089fbfd expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217100.032760:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e682170400/0xf210a9075089fc04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089fbfd expref: 11 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217100.032769:0:14155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e682170400/0xf210a9075089fc04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089fbfd expref: 11 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217100.032777:0:14155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e682170400, rc 0) 00000100:00100000:3.0:1782217100.032816:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f2b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+11:14145:x1868789734004992:12345-0@lo:101:mount.lustre.0 Request processed in 109us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217100.032823:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782217100.032910:0:14145:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f79dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14145:1868789734004992:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782217100.032922:0:14145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e67437a400/0xf210a9075089fbfd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fc04 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217100.032930:0:14145:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e67437a400/0xf210a9075089fbfd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089fc04 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217100.032986:0:14145:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f79dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14145:1868789734005120:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782217100.033011:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217100.033298:0:14145:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e680504240 going to sleep for 11 seconds 00000100:00100000:1.0:1782217100.033422:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734005120 00000100:00100000:1.0:1782217100.033427:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734005120 00000100:00100000:1.0:1782217100.033451:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782217100.033457:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f2b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+11:14145:x1868789734005120:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782217100.033867:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f2b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+11:14145:x1868789734005120:12345-0@lo:501:mount.lustre.0 Request processed in 401us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217100.033892:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782217100.034172:0:14145:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f79dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14145:1868789734005120:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782217100.034270:0:14145:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f79dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14145:1868789734005248:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782217100.034370:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217100.034426:0:14145:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e680504240 going to sleep for 11 seconds 00000100:00100000:2.0:1782217100.034460:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734005248 00000100:00100000:2.0:1782217100.034465:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734005248 00000100:00100000:1.0:1782217100.034508:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782217100.034516:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f2b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+11:14145:x1868789734005248:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782217100.034655:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f2b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+11:14145:x1868789734005248:12345-0@lo:503:mount.lustre.0 Request processed in 139us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217100.034661:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782217100.034747:0:14145:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f79dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14145:1868789734005248:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782217100.035204:0:14188:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f79dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:713996b4-9a75-4cc4-875d-de8926ad5952:14188:1868789734005376:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782217100.035236:0:14188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217100.035263:0:14188:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e65c3fc780 going to sleep for 11 seconds 00000100:00100000:3.0:1782217100.035323:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734005376 00000100:00100000:3.0:1782217100.035328:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734005376 00000100:00100000:3.0:1782217100.035357:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782217100.035364:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f2b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+11:14188:x1868789734005376:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782217100.035537:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f2b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+11:14188:x1868789734005376:12345-0@lo:502:llog_process_th.0 Request processed in 173us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217100.035543:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782217100.035727:0:14188:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f79dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:713996b4-9a75-4cc4-875d-de8926ad5952:14188:1868789734005376:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782217100.035749:0:14188:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782217100.035758:0:14188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217100.035760:0:14188:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1782217100.035768:0:14188:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff88e652461000 00000020:00000080:0.0:1782217100.035770:0:14188:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782217100.035778:0:14188:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782217100.035794:0:14188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217100.035796:0:14188:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1782217100.035800:0:14188:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782217100.035803:0:14188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217100.035804:0:14188:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1782217100.035808:0:14188:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff88e652461000 00000020:00000080:0.0:1782217100.035810:0:14188:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782217100.035898:0:14188:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782217100.035903:0:14188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217100.035904:0:14188:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1782217100.035907:0:14188:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782217100.035909:0:14188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217100.035910:0:14188:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1782217100.035914:0:14188:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88e652461000 00000020:00000080:0.0:1782217100.035915:0:14188:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1782217100.035950:0:14188:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f79dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:713996b4-9a75-4cc4-875d-de8926ad5952:14188:1868789734005504:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782217100.035982:0:14188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217100.036002:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734005504 00000100:00100000:0.0:1782217100.036006:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734005504 00000100:00100000:0.0:1782217100.036025:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782217100.036031:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f2b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+11:14188:x1868789734005504:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782217100.036143:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f2b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+11:14188:x1868789734005504:12345-0@lo:502:llog_process_th.0 Request processed in 111us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217100.036149:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782217100.036174:0:14188:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e65c3fc780 going to sleep for 11 seconds 00000100:00100000:0.0:1782217100.036199:0:14188:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f79dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:713996b4-9a75-4cc4-875d-de8926ad5952:14188:1868789734005504:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782217100.036216:0:14188:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782217100.036220:0:14188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217100.036221:0:14188:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1782217100.036225:0:14188:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1782217100.038071:0:14145:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1782217100.038099:0:14145:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782217100.038116:0:14145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67437a400/0xf210a9075089fbfd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fc04 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217100.038129:0:14145:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e67437a400/0xf210a9075089fbfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fc04 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782217100.038171:0:14145:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1782217100.038173:0:14145:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88e652461000 10000000:01000000:1.0:1782217100.038176:0:14145:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88e652461000 10000000:01000000:1.0:1782217100.038181:0:14145:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782217100.038186:0:14145:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff88e652461000 from 1 10000000:01000000:1.0:1782217100.038189:0:14145:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782217100.038220:0:14145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67fd07000/0xf210a9075089fc0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217100.038228:0:14145:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e67fd07000/0xf210a9075089fc0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217100.038238:0:14145:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e67fd07000/0xf210a9075089fc0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217100.038258:0:14145:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664484700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14145:1868789734005632:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782217100.038777:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217100.038846:0:14145:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e660b1ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1782217100.040239:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734005632 00000100:00100000:2.0:1782217100.040250:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734005632 00000100:00100000:2.0:1782217100.040297:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782217100.040306:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f2b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+11:14145:x1868789734005632:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782217100.040321:0:14157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217100.040338:0:14157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e6738af600/0xf210a9075089fc12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089fc0b expref: -99 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217100.040364:0:14157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e6738af600/0xf210a9075089fc12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089fc0b expref: 12 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217100.040374:0:14157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e6738af600/0xf210a9075089fc12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089fc0b expref: 12 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217100.040383:0:14157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738af600, rc 0) 00000100:00100000:2.0:1782217100.040724:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f2b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+12:14145:x1868789734005632:12345-0@lo:101:mount.lustre.0 Request processed in 416us (1947us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217100.040730:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782217100.040800:0:14145:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664484700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14145:1868789734005632:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782217100.040816:0:14145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e67fd07000/0xf210a9075089fc0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fc12 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217100.040826:0:14145:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e67fd07000/0xf210a9075089fc0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089fc12 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217100.041028:0:14145:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14145:1868789734005760:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782217100.041062:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217100.041087:0:14145:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e67a0e4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782217100.041101:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734005760 00000100:00100000:2.0:1782217100.041105:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734005760 00000100:00100000:2.0:1782217100.041132:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782217100.041140:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6644d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+12:14145:x1868789734005760:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782217100.041430:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6644d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+12:14145:x1868789734005760:12345-0@lo:501:mount.lustre.0 Request processed in 290us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217100.041437:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782217100.041470:0:14145:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14145:1868789734005760:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782217100.041510:0:14145:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14145:1868789734005888:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782217100.041548:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217100.042479:0:14145:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e67a0e4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782217100.043155:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734005888 00000100:00100000:0.0:1782217100.043162:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734005888 00000100:00100000:0.0:1782217100.043262:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782217100.043273:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6644d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+12:14145:x1868789734005888:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782217100.043472:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6644d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+12:14145:x1868789734005888:12345-0@lo:503:mount.lustre.0 Request processed in 201us (1922us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217100.043487:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782217100.043889:0:14145:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14145:1868789734005888:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782217100.044442:0:14191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67420c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:713996b4-9a75-4cc4-875d-de8926ad5952:14191:1868789734006016:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782217100.044491:0:14191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217100.044525:0:14191:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e657794c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782217100.044627:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734006016 00000100:00100000:2.0:1782217100.044633:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734006016 00000100:00100000:2.0:1782217100.044674:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782217100.044701:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6644d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+12:14191:x1868789734006016:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782217100.045120:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6644d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+12:14191:x1868789734006016:12345-0@lo:502:llog_process_th.0 Request processed in 420us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217100.045127:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782217100.046194:0:14191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67420c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:713996b4-9a75-4cc4-875d-de8926ad5952:14191:1868789734006016:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1782217100.046260:0:14191:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1782217100.046281:0:14191:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff88e651fc19c0) 00000020:00000080:3.0:1782217100.046298:0:14191:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1782217100.049225:0:14191:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88e652461000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1782217100.049233:0:14191:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88e652461000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1782217100.049237:0:14191:0:(obd_mount.c:701:lustre_put_lsi()) put ffff88e652461000 4 00010000:00080000:2.0:1782217100.049278:0:14191:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88e664dc3800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.119@tcp at head 00010000:00010000:2.0:1782217100.059655:0:14191:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1782217100.059783:0:14191:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1782217100.059821:0:14191:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1782217100.059833:0:14191:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf210a9075089fc20 00000100:00080000:2.0:1782217100.059845:0:14191:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782217100.059850:0:14191:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff88e664dc3800 using connection 192.168.203.119@tcp/0@lo 00000100:00100000:2.0:1782217100.059918:0:14191:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88e64e2a1500 x1868789734006144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782217100.059946:0:14191:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1782217100.062434:0:3300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1868789734006144:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1782217100.062504:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217100.063549:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734006144 00000100:00100000:2.0:1782217100.063558:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734006144 00000100:00100000:2.0:1782217100.063596:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782217100.063603:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f79dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3300:x1868789734006144:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1782217100.063664:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f79dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3300:x1868789734006144:12345-0@lo:38:llog_process_th.0 Request processed in 60us (1159us total) trans 0 rc -11/-11 00000100:00100000:2.0:1782217100.063672:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782217100.067199:0:3300:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782217100.067211:0:3300:0:(import.c:65:import_set_state_nolock()) ffff88e664dc3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782217100.067218:0:3300:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1782217100.067223:0:3300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1868789734006144:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1782217100.068502:0:14191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:713996b4-9a75-4cc4-875d-de8926ad5952:14191:1868789734006272:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782217100.068580:0:14191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217100.068627:0:14191:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e67a0e4180 going to sleep for 11 seconds 00000100:00100000:0.0:1782217100.069988:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734006272 00000100:00100000:0.0:1782217100.070173:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734006272 00000100:00100000:0.0:1782217100.070223:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782217100.070233:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6644d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+12:14191:x1868789734006272:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782217100.072529:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6644d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+12:14191:x1868789734006272:12345-0@lo:502:llog_process_th.0 Request processed in 2290us (3942us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217100.072541:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782217100.073914:0:14191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:713996b4-9a75-4cc4-875d-de8926ad5952:14191:1868789734006272:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1782217100.073952:0:14191:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1782217100.074184:0:14145:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1782217100.074204:0:14145:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782217100.074220:0:14145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67fd07000/0xf210a9075089fc0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fc12 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217100.074231:0:14145:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e67fd07000/0xf210a9075089fc0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fc12 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1782217100.074278:0:14145:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1782217100.074280:0:14145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782217100.074282:0:14145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782217100.074283:0:14145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782217100.074284:0:14145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782217100.074286:0:14145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782217100.074287:0:14145:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782217100.074288:0:14145:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782217100.074290:0:14145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782217100.074292:0:14145:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782217100.074295:0:14145:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1782217100.074297:0:14145:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782217100.074298:0:14145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782217100.074300:0:14145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782217100.074301:0:14145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782217100.074302:0:14145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782217100.074303:0:14145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782217100.074304:0:14145:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782217100.074305:0:14145:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782217100.074306:0:14145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782217100.074307:0:14145:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782217100.074326:0:14145:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1782217100.074343:0:14145:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14145:1868789734006400:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1782217100.075507:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217100.075549:0:14145:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e67a0e4180 going to sleep for 11 seconds 00000100:00100000:2.0:1782217100.075573:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734006400 00000100:00100000:2.0:1782217100.075580:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734006400 00000100:00100000:2.0:1782217100.075615:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782217100.075623:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6644d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+12:14145:x1868789734006400:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1782217100.075661:0:14157:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1782217100.075674:0:14157:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1782217100.138502:0:14157:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1782217100.138558:0:14157:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1782217100.138680:0:14178:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1782217100.138697:0:14178:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1782217100.138719:0:14178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88e682171600/0xf210a9075089fc27 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217100.138738:0:14178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88e6738ae800/0xf210a9075089fbf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089fbef expref: 12 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217100.138747:0:14178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88e682171600/0xf210a9075089fc27 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217100.138837:0:14178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88e6738ae800/0xf210a9075089fbf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf210a9075089fbef expref: 12 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217100.138852:0:14178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88e6738ae800/0xf210a9075089fbf6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf210a9075089fbef expref: 12 pid: 14157 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217100.138867:0:14178:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67420c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14178:1868789734006528:0@lo:104: 00000100:00100000:3.0:1782217100.138944:0:14178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217100.140502:0:14146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734006528 00000100:00100000:0.0:1782217100.140511:0:14146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734006528 00000100:00100000:0.0:1782217100.140665:0:14146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782217100.140676:0:14146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67420f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:713996b4-9a75-4cc4-875d-de8926ad5952+3:14178:x1868789734006528:12345-0@lo:104: 00010000:00010000:0.0:1782217100.140701:0:14146:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.119@tcp lock: ffff88e67fd07600/0xf210a9075089fbef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089fbf6 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217100.140766:0:14146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782217100.140772:0:14146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67420f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:713996b4-9a75-4cc4-875d-de8926ad5952+3:14178:x1868789734006528:12345-0@lo:104: Request processed in 99us (1829us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217100.140780:0:14146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1782217100.140974:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217100.140981:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e67fd07600/0xf210a9075089fbef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089fbf6 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217100.140989:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07600 already unused, calling callback (ffffffffc1d2fc20) 10000000:00010000:3.0:1782217100.140993:0:14152:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e67fd07600/0xf210a9075089fbef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf210a9075089fbf6 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217100.141002:0:14152:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e67fd07600/0xf210a9075089fbef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf210a9075089fbf6 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782217100.141021:0:14152:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e67fd07600/0xf210a9075089fbef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf210a9075089fbf6 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782217100.141026:0:14152:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1782217100.141065:0:14152:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: ffff88e67fd07600/0xf210a9075089fbef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089fbf6 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217100.141072:0:14152:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782217100.141094:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e67fd07600/0xf210a9075089fbef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089fbf6 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217100.141101:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e67fd07600/0xf210a9075089fbef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089fbf6 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217100.141119:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217100.141121:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217100.141123:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217100.141130:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782217100.141141:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67420f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:713996b4-9a75-4cc4-875d-de8926ad5952:3301:1868789734006656:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782217100.141174:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217100.141244:0:14148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734006656 00000100:00100000:3.0:1782217100.141249:0:14148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734006656 00010000:00010000:3.0:1782217100.141267:0:14148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88e6738ae800/0xf210a9075089fbf6 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089fbef expref: 13 pid: 14157 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217100.141288:0:14148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782217100.141293:0:14148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67420ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:713996b4-9a75-4cc4-875d-de8926ad5952+13:3301:x1868789734006656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782217100.141303:0:14148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217100.141314:0:14148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88e6738ae800/0xf210a9075089fbf6 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089fbef expref: 13 pid: 14157 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217100.141325:0:14148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88e6738ae800/0xf210a9075089fbf6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf210a9075089fbef expref: 13 pid: 14157 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217100.141341:0:14148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88e682171600/0xf210a9075089fc27 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217100.141350:0:14148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e682171600/0xf210a9075089fc27 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1782217100.141362:0:14148:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002678396s 00010000:00010000:3.0:1782217100.141367:0:14148:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88e682171600/0xf210a9075089fc27 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217100.141374:0:14148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88e682171600/0xf210a9075089fc27 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217100.141381:0:14148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88e682171600/0xf210a9075089fc27 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217100.141386:0:14148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88e682171600/0xf210a9075089fc27 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217100.141392:0:14148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e682171600 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217100.141396:0:14148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88e682171600/0xf210a9075089fc27 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217100.141404:0:14148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88e682171600/0xf210a9075089fc27 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217100.141412:0:14148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88e682171600/0xf210a9075089fc27 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217100.141427:0:14148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217100.141453:0:14148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67420ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:713996b4-9a75-4cc4-875d-de8926ad5952+13:3301:x1868789734006656:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217100.141460:0:14148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782217100.141494:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67420f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:713996b4-9a75-4cc4-875d-de8926ad5952:3301:1868789734006656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782217100.141851:0:14178:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6462143c0 going to sleep for 11 seconds 00010000:00010000:2.0:1782217100.141870:0:14178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e6738ae800/0xf210a9075089fbf6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf210a9075089fbef expref: 12 pid: 14157 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217100.141976:0:14178:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67420c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14178:1868789734006528:0@lo:104: 00010000:00010000:2.0:1782217100.142049:0:14178:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88e682171600/0xf210a9075089fc27 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217100.142059:0:14178:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88e682171600/0xf210a9075089fc27 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217100.142065:0:14178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88e682171600/0xf210a9075089fc27 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217100.142072:0:14178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e682171600/0xf210a9075089fc27 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217100.145359:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6644d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+11:14145:x1868789734006400:12345-0@lo:253:mount.lustre.0 Request processed in 69730us (69848us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217100.145373:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782217100.145419:0:14145:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14145:1868789734006400:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1782217100.145442:0:14145:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1782217100.145445:0:14145:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782217100.145446:0:14145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782217100.145459:0:14145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782217100.145461:0:14145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782217100.145462:0:14145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782217100.145463:0:14145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782217100.145464:0:14145:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782217100.145465:0:14145:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782217100.145467:0:14145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782217100.145468:0:14145:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1782217100.145480:0:14145:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1782217100.156023:0:14145:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1782217100.156202:0:14145:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1782217100.156683:0:14145:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1782217100.156851:0:14145:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1782217100.157443:0:14145:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1782217100.158728:0:14145:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1782217100.161270:0:14145:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1782217100.161436:0:14145:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1782217100.162189:0:14145:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1782217100.162831:0:14145:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1782217100.163186:0:14145:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1782217100.163352:0:14145:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1782217100.188463:0:14145:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1782217100.190321:0:14145:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1782217100.190703:0:14202:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1782217100.190796:0:14202:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1782217100.192597:0:14201:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1782217100.192603:0:14201:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1782217100.194670:0:14145:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1782217100.194810:0:14145:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1782217100.195319:0:14145:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1782217100.195325:0:14145:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1782217100.195435:0:14145:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782217100.198055:0:14145:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1782217100.199413:0:14145:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1782217100.199473:0:14145:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1782217100.200098:0:14145:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:1.0:1782217100.201464:0:14145:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000040:00080000:0.0:1782217100.203702:0:14202:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1782217100.203782:0:14202:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1782217100.203786:0:14202:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00000004:1.0:1782217100.208318:0:14145:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1782217100.241771:0:14145:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1782217100.241807:0:14145:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb4d081c87988 00100000:10000000:1.0:1782217100.241815:0:14145:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1782217100.242673:0:14145:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1782217100.242697:0:14145:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.119@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1782217100.242713:0:14145:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1782217100.242730:0:14145:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1782217100.756031:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782217101.140610:0:14196:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782217101.140618:0:14196:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782217101.141551:0:14196:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:2.0:1782217101.141568:0:14196:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:2.0:1782217101.275466:0:14160:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1782217101.275473:0:14160:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff88e652461000 from 6 10000000:01000000:2.0:1782217101.275477:0:14160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782217101.275521:0:14160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e6738afa00/0xf210a9075089fc2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217101.275532:0:14160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e6738afa00/0xf210a9075089fc2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217101.275543:0:14160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e6738afa00/0xf210a9075089fc2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217101.275577:0:14160:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:713996b4-9a75-4cc4-875d-de8926ad5952:14160:1868789734006784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782217101.275640:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217101.275705:0:14160:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e67a0e4000 going to sleep for 11 seconds 00000100:00100000:3.0:1782217101.275900:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734006784 00000100:00100000:3.0:1782217101.275908:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734006784 00000100:00100000:3.0:1782217101.275951:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782217101.275961:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6644d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+11:14160:x1868789734006784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782217101.275985:0:14155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217101.275998:0:14155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e682171400/0xf210a9075089fc35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089fc2e expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217101.276022:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e682171400/0xf210a9075089fc35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089fc2e expref: 12 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217101.276032:0:14155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e682171400/0xf210a9075089fc35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089fc2e expref: 12 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217101.276040:0:14155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e682171400, rc 0) 00000100:00100000:3.0:1782217101.276078:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6644d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+12:14160:x1868789734006784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217101.276084:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782217101.276231:0:14160:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:713996b4-9a75-4cc4-875d-de8926ad5952:14160:1868789734006784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782217101.276245:0:14160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e6738afa00/0xf210a9075089fc2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fc35 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217101.276260:0:14160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e6738afa00/0xf210a9075089fc2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089fc35 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217101.276321:0:14160:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:713996b4-9a75-4cc4-875d-de8926ad5952:14160:1868789734006912:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1782217101.276355:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217101.276386:0:14160:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e67a0e4000 going to sleep for 11 seconds 00000100:00100000:3.0:1782217101.276499:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734006912 00000100:00100000:3.0:1782217101.276504:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734006912 00000100:00100000:3.0:1782217101.276535:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782217101.276542:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6644d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+12:14160:x1868789734006912:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1782217101.276556:0:14157:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1782217101.276573:0:14157:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1782217101.276577:0:14157:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1782217101.276666:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6644d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+12:14160:x1868789734006912:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217101.276673:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782217101.276932:0:14160:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:713996b4-9a75-4cc4-875d-de8926ad5952:14160:1868789734006912:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1782217101.276971:0:14160:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1782217101.276978:0:14160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e6738afa00/0xf210a9075089fc2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fc35 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217101.276985:0:14160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e6738afa00/0xf210a9075089fc2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fc35 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217101.780133:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782217102.170531:0:14196:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782217102.170540:0:14196:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782217102.171272:0:14196:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1782217102.171353:0:14196:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782217102.171387:0:14196:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:3.0:1782217102.806624:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217103.832463:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217104.852320:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782217105.370848:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782217105.370860:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782217105.370863:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782217105.370866:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782217105.370868:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1782217105.370871:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1782217105.370892:0:8:0:(import.c:65:import_set_state_nolock()) ffff88e664dc3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782217105.370906:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff88e664dc3800 using connection 192.168.203.119@tcp/0@lo 00000100:00100000:3.0:1782217105.370927:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88e67420f100 x1868789734007168/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782217105.370998:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67420f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:713996b4-9a75-4cc4-875d-de8926ad5952:3303:1868789734007040:0@lo:400:kworker.0 00000100:00100000:3.0:1782217105.371062:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217105.371130:0:3300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67420f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1868789734007168:0@lo:38:kworker.0 00000100:00100000:3.0:1782217105.371162:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217105.371222:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734007040 00000100:00100000:3.0:1782217105.371230:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734007040 00000100:00100000:3.0:1782217105.371268:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782217105.371276:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6644d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+12:3303:x1868789734007040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217105.371322:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6644d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+12:3303:x1868789734007040:12345-0@lo:400:kworker.0 Request processed in 46us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217105.371329:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782217105.371368:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734007168 00000100:00100000:3.0:1782217105.371372:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734007168 00000100:00100000:3.0:1782217105.371390:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782217105.371394:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67420df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3300:x1868789734007168:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1782217105.371422:0:14164:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 424 last 0 00000020:00000080:3.0:1782217105.371453:0:14164:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf210a9075089fc3c 00000004:00100000:3.0:1782217105.371467:0:14164:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1782217105.371583:0:14164:0:(import.c:65:import_set_state_nolock()) ffff88e655b6d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782217105.371622:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67420df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1868789734007168:12345-0@lo:38:kworker.0 Request processed in 225us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217105.371629:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782217105.371675:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67420f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:713996b4-9a75-4cc4-875d-de8926ad5952:3303:1868789734007040:0@lo:400:kworker.0 00010000:00080000:3.0:1782217105.371702:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88e67420f100 x1868789734007168/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782217115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1782217105.371715:0:3300:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1782217105.371722:0:3300:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1782217105.371726:0:3300:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1782217105.371728:0:3300:0:(import.c:65:import_set_state_nolock()) ffff88e664dc3800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1782217105.371734:0:3300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67420f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1868789734007168:0@lo:38:kworker.0 00000001:02000400:0.0:1782217105.427301:0:14445:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg319-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1782217105.885797:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217106.899977:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217107.925752:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782217108.595292:0:14595:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc97687770 20000000:00000080:1.0:1782217108.595307:0:14595:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88e65240e400 uarg=0000000000000000 20000000:01000000:1.0:1782217108.595340:0:14595:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1782217108.595346:0:14595:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1782217108.595351:0:14595:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1782217108.598840:0:14596:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1782217108.599128:0:14595:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1782217108.609097:0:14595:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1782217108.613303:0:14595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88e6738ae000/0xf210a9075089fc43 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217108.613323:0:14595:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88e682170400/0xf210a9075089fc04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089fbfd expref: 11 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217108.613331:0:14595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88e6738ae000/0xf210a9075089fc43 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217108.613366:0:14595:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88e682170400/0xf210a9075089fc04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf210a9075089fbfd expref: 11 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217108.613377:0:14595:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88e682170400/0xf210a9075089fc04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf210a9075089fbfd expref: 11 pid: 14155 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217108.613397:0:14595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14595:1868789734007296:0@lo:104: 00000100:00100000:2.0:1782217108.613446:0:14595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217108.613494:0:14595:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6738e7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782217108.613549:0:14146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734007296 00000100:00100000:0.0:1782217108.613602:0:14146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734007296 00000100:00100000:0.0:1782217108.613663:0:14146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782217108.613673:0:14146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:713996b4-9a75-4cc4-875d-de8926ad5952+3:14595:x1868789734007296:12345-0@lo:104: 00010000:00010000:0.0:1782217108.613685:0:14146:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.119@tcp lock: ffff88e67437a400/0xf210a9075089fbfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089fc04 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217108.613852:0:14146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782217108.613859:0:14146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:713996b4-9a75-4cc4-875d-de8926ad5952+3:14595:x1868789734007296:12345-0@lo:104: Request processed in 188us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217108.613865:0:14146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782217108.614132:0:14595:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14595:1868789734007296:0@lo:104: 00010000:00010000:2.0:1782217108.614153:0:14595:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88e6738ae000/0xf210a9075089fc43 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217108.614234:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217108.614241:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e67437a400/0xf210a9075089fbfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089fc04 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217108.614248:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437a400 already unused, calling callback (ffffffffc1d2fc20) 10000000:00010000:3.0:1782217108.614252:0:14151:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e67437a400/0xf210a9075089fbfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf210a9075089fc04 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217108.614260:0:14151:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e67437a400/0xf210a9075089fbfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf210a9075089fc04 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782217108.614273:0:14151:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e67437a400/0xf210a9075089fbfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf210a9075089fc04 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782217108.614278:0:14151:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782217108.614316:0:14151:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: ffff88e67437a400/0xf210a9075089fbfd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089fc04 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217108.614322:0:14151:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782217108.614348:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e67437a400/0xf210a9075089fbfd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089fc04 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217108.614355:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e67437a400/0xf210a9075089fbfd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089fc04 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217108.614369:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217108.614371:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217108.614372:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217108.614378:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782217108.614387:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67420f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:713996b4-9a75-4cc4-875d-de8926ad5952:3303:1868789734007424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782217108.614415:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217108.614447:0:14148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734007424 00000100:00100000:3.0:1782217108.614451:0:14148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734007424 00010000:00010000:3.0:1782217108.614473:0:14148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88e682170400/0xf210a9075089fc04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089fbfd expref: 12 pid: 14155 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217108.614494:0:14148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782217108.614500:0:14148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67420f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:713996b4-9a75-4cc4-875d-de8926ad5952+12:3303:x1868789734007424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782217108.614510:0:14148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217108.614520:0:14148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88e682170400/0xf210a9075089fc04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089fbfd expref: 12 pid: 14155 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217108.614530:0:14148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88e682170400/0xf210a9075089fc04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf210a9075089fbfd expref: 12 pid: 14155 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217108.614543:0:14148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e682170400/0xf210a9075089fc04 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf210a9075089fbfd expref: 12 pid: 14155 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217108.614556:0:14148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88e6738ae000/0xf210a9075089fc43 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217108.614563:0:14148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e6738ae000/0xf210a9075089fc43 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217108.614577:0:14148:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88e6738ae000/0xf210a9075089fc43 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217108.614583:0:14148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88e6738ae000/0xf210a9075089fc43 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217108.614590:0:14148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88e6738ae000/0xf210a9075089fc43 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217108.614595:0:14148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88e6738ae000/0xf210a9075089fc43 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217108.614677:0:14148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738ae000 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217108.614680:0:14148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88e6738ae000/0xf210a9075089fc43 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217108.614687:0:14148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88e6738ae000/0xf210a9075089fc43 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217108.614700:0:14148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88e6738ae000/0xf210a9075089fc43 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217108.614708:0:14148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217108.614743:0:14148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67420f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:713996b4-9a75-4cc4-875d-de8926ad5952+11:3303:x1868789734007424:12345-0@lo:103:ldlm_bl.0 Request processed in 243us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217108.614749:0:14148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782217108.614777:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67420f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:713996b4-9a75-4cc4-875d-de8926ad5952:3303:1868789734007424:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782217108.614817:0:14595:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88e6738ae000/0xf210a9075089fc43 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217108.614824:0:14595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88e6738ae000/0xf210a9075089fc43 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217108.614830:0:14595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e6738ae000/0xf210a9075089fc43 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217108.948270:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782217109.847935:0:14160:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782217109.847943:0:14160:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff88e652461000 from 10 10000000:01000000:0.0:1782217109.847948:0:14160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782217109.847993:0:14160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67437aa00/0xf210a9075089fc4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217109.848005:0:14160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e67437aa00/0xf210a9075089fc4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217109.848016:0:14160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e67437aa00/0xf210a9075089fc4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217109.848052:0:14160:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f79c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:713996b4-9a75-4cc4-875d-de8926ad5952:14160:1868789734007552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782217109.848118:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217109.848170:0:14160:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e650a4da80 going to sleep for 11 seconds 00000100:00100000:2.0:1782217109.848299:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734007552 00000100:00100000:2.0:1782217109.848307:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734007552 00000100:00100000:2.0:1782217109.848361:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782217109.848370:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6644d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+11:14160:x1868789734007552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782217109.848383:0:14155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217109.848395:0:14155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e6738af800/0xf210a9075089fc51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089fc4a expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217109.848418:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e6738af800/0xf210a9075089fc51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089fc4a expref: 12 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217109.848439:0:14155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e6738af800/0xf210a9075089fc51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089fc4a expref: 12 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217109.848448:0:14155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738af800, rc 0) 00000100:00100000:2.0:1782217109.848488:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6644d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+12:14160:x1868789734007552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217109.848495:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782217109.848536:0:14160:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f79c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:713996b4-9a75-4cc4-875d-de8926ad5952:14160:1868789734007552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782217109.848549:0:14160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e67437aa00/0xf210a9075089fc4a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fc51 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217109.848558:0:14160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e67437aa00/0xf210a9075089fc4a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089fc51 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217109.849412:0:14160:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:713996b4-9a75-4cc4-875d-de8926ad5952:14160:1868789734007680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782217109.849450:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217109.851155:0:14160:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6434d1240 going to sleep for 11 seconds 00000100:00100000:0.0:1782217109.851435:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734007680 00000100:00100000:0.0:1782217109.851443:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734007680 00000100:00100000:0.0:1782217109.852777:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782217109.852800:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6644d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+12:14160:x1868789734007680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782217109.853122:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6644d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+12:14160:x1868789734007680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 331us (3670us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217109.853132:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782217109.853164:0:14160:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:713996b4-9a75-4cc4-875d-de8926ad5952:14160:1868789734007680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782217109.853221:0:14160:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:713996b4-9a75-4cc4-875d-de8926ad5952:14160:1868789734007808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782217109.853273:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217109.853357:0:14160:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6434d1240 going to sleep for 11 seconds 00000100:00100000:0.0:1782217109.853499:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734007808 00000100:00100000:0.0:1782217109.853507:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734007808 00000100:00100000:0.0:1782217109.853665:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782217109.853674:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6644d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+12:14160:x1868789734007808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782217109.853829:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6644d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+12:14160:x1868789734007808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217109.853835:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782217109.853987:0:14160:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:713996b4-9a75-4cc4-875d-de8926ad5952:14160:1868789734007808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782217109.857824:0:14632:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1782217109.858075:0:14160:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1782217109.858095:0:14160:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782217109.858106:0:14160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67437aa00/0xf210a9075089fc4a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fc51 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217109.858129:0:14160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e67437aa00/0xf210a9075089fc4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fc51 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217109.974503:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782217110.483982:0:3300:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782217100/real 1782217100] req@ffff88e664486680 x1868789734004480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782217110 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217110.484013:0:3300:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88e664486680 x1868789734004480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782217110 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217110.484041:0:3300:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782217100/real 1782217100] req@ffff88e67420dc00 x1868789734004224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782217110 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217110.484054:0:3300:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88e67420dc00 x1868789734004224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782217110 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1782217110.484073:0:3300:0:(import.c:65:import_set_state_nolock()) ffff88e650a33000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782217110.484099:0:3300:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1782217110.484103:0:3300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1868789734004480:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1782217110.484109:0:3300:0:(import.c:65:import_set_state_nolock()) ffff88e67418a000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782217110.484114:0:3300:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1782217110.484118:0:3300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67420dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1868789734004224:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1782217110.484354:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782217110.484359:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1782217110.484362:0:8:0:(import.c:65:import_set_state_nolock()) ffff88e67418a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782217110.484367:0:8:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 419 00000100:00080000:0.0:1782217110.484372:0:8:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1782217110.484379:0:8:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff88e67418a000 using connection 192.168.203.119@tcp/0@lo 00000100:00100000:0.0:1782217110.484397:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88e67f79f800 x1868789734008064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782217110.484417:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782217110.484420:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1782217110.484421:0:8:0:(import.c:65:import_set_state_nolock()) ffff88e650a33000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782217110.484425:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 419 00000100:00080000:0.0:1782217110.484427:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1782217110.484430:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88e650a33000 using connection 192.168.203.119@tcp/0@lo 00000100:00100000:0.0:1782217110.484441:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88e67f79df80 x1868789734008192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782217110.484557:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f79ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1868789734008320:0@lo:400:kworker.0 00000100:00100000:2.0:1782217110.484641:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217110.484739:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782217110.484746:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f79f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:713996b4-9a75-4cc4-875d-de8926ad5952:3302:1868789734007936:0@lo:400:kworker.0 00000100:00100000:2.0:1782217110.484777:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217110.484820:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734008320 00000100:00100000:2.0:1782217110.484827:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734008320 00000100:00100000:2.0:1782217110.484866:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782217110.484874:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1868789734008320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217110.484949:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1868789734008320:12345-0@lo:400:kworker.0 Request processed in 75us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217110.484956:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782217110.484976:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734007936 00000100:00100000:2.0:1782217110.484985:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734007936 00000100:00100000:2.0:1782217110.485008:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782217110.485013:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6644d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+12:3302:x1868789734007936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217110.485043:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6644d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+12:3302:x1868789734007936:12345-0@lo:400:kworker.0 Request processed in 30us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217110.485049:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782217110.485077:0:3300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f79f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1868789734008064:0@lo:8:kworker.0 00000400:00000100:2.0:1782217110.485100:0:3300:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868789734008064 offset 0 length 520: 4 00000100:00100000:2.0:1782217110.485116:0:3300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f79df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1868789734008192:0@lo:8:kworker.0 00000400:00000100:2.0:1782217110.485132:0:3300:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868789734008192 offset 0 length 520: 4 00000100:00100000:2.0:1782217110.485159:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f79f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:713996b4-9a75-4cc4-875d-de8926ad5952:3302:1868789734007936:0@lo:400:kworker.0 00010000:00080000:2.0:1782217110.485170:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88e67f79ca80 x1868789734008320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217110.485180:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f79ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1868789734008320:0@lo:400:kworker.0 00010000:00010000:2.0:1782217110.995999:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217112.020180:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782217112.408662:0:14196:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1782217113.045406:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1782217113.459748:0:14797:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1782217113.459752:0:14797:0:(obd_mount.c:917:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1782217113.459905:0:14797:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff88e643535000 00000020:01000004:3.0:1782217113.459920:0:14797:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1782217113.459932:0:14797:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1782217113.459962:0:14797:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff88e67421cd40) 00000020:00000080:3.0:1782217113.459978:0:14797:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1782217113.496942:0:14797:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1782217113.497295:0:14797:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1782217113.503321:0:14797:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1782217113.505401:0:14797:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1782217113.508935:0:14797:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1782217113.512692:0:14797:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 485: rc = 0 00100000:10000000:3.0:1782217113.512870:0:14797:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 485: rc = 0 00100000:10000000:3.0:1782217113.514512:0:14797:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 485: rc = 0 00100000:10000000:3.0:1782217113.517188:0:14797:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 628: rc = 0 00100000:10000000:3.0:1782217113.519293:0:14797:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 628: rc = 0 00100000:10000000:3.0:1782217113.519842:0:14797:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 628: rc = 0 00100000:10000000:3.0:1782217113.521494:0:14797:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 628: rc = 0 00100000:10000000:3.0:1782217113.521857:0:14797:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 628: rc = 0 00100000:10000000:3.0:1782217113.523219:0:14797:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 628: rc = 0 00000020:00000080:3.0:1782217113.525387:0:14797:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1782217113.525407:0:14797:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1782217113.525417:0:14797:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf210a9075089fc5f 00000020:01000004:3.0:1782217113.525426:0:14797:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1782217113.525446:0:14797:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.119@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1782217113.525450:0:14797:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.119@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1782217113.525456:0:14797:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1782217113.525461:0:14797:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1782217113.525473:0:14797:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff88e6742199c0) 00000020:00000080:3.0:1782217113.525484:0:14797:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1782217113.526777:0:14797:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782217113.526953:0:14797:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1782217113.526959:0:14797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1782217113.531529:0:14797:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1782217113.531552:0:14797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1782217113.532538:0:14797:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1782217113.532548:0:14797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1782217113.538289:0:14797:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782217113.538512:0:14797:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1782217113.538519:0:14797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1782217113.542234:0:14797:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1782217113.542247:0:14797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1782217113.570243:0:14797:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782217113.572641:0:14797:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1782217113.572655:0:14797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1782217113.585684:0:14797:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1782217113.585700:0:14797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1782217113.586356:0:14797:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1782217113.586364:0:14797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1782217113.588086:0:14797:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782217113.588246:0:14797:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1782217113.588251:0:14797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1782217113.589991:0:14797:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1782217113.590001:0:14797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1782217113.676284:0:14797:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782217113.676614:0:14797:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1782217113.676620:0:14797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1782217113.678335:0:14797:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1782217113.678346:0:14797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1782217113.679581:0:14797:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1782217113.679615:0:14797:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1782217113.679620:0:14797:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.119@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1782217113.694555:0:14797:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.119@tcp ctxt 0 is initialized 00000020:01000004:2.0:1782217113.694612:0:14797:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.119@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1782217113.694620:0:14797:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1782217113.694622:0:14797:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782217113.694623:0:14797:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782217113.694624:0:14797:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782217113.694626:0:14797:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782217113.694627:0:14797:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782217113.694629:0:14797:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782217113.694630:0:14797:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782217113.694631:0:14797:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782217113.694635:0:14797:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1782217113.694637:0:14797:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782217113.694638:0:14797:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782217113.694639:0:14797:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782217113.694640:0:14797:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782217113.694641:0:14797:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782217113.694642:0:14797:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782217113.694643:0:14797:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782217113.694644:0:14797:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782217113.694645:0:14797:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782217113.694730:0:14797:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1782217113.694750:0:14797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14797:1868789734008448:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1782217113.694814:0:14797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217113.694931:0:14797:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e652abb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782217113.695020:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734008448 00000100:00100000:3.0:1782217113.695027:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734008448 00000100:00100000:3.0:1782217113.695107:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782217113.695116:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6644d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+12:14797:x1868789734008448:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1782217113.695163:0:14155:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1782217113.695166:0:14155:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1782217113.695170:0:14155:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1782217113.721854:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6644d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+12:14797:x1868789734008448:12345-0@lo:253:mount.lustre.0 Request processed in 26732us (27032us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217113.721869:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782217113.721984:0:14797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14797:1868789734008448:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1782217113.722000:0:14797:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1782217113.722003:0:14797:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782217113.722004:0:14797:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1782217113.722006:0:14797:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782217113.722007:0:14797:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782217113.722008:0:14797:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782217113.722009:0:14797:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782217113.722011:0:14797:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782217113.722013:0:14797:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782217113.722014:0:14797:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1782217113.722036:0:14797:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88e643535000 from lustre-OST0000 10000000:01000000:1.0:1782217113.722061:0:14797:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1782217113.722064:0:14797:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1782217113.722071:0:14797:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff88e67a633380 local copy 00010000:00010000:1.0:1782217113.722188:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67fd06c00/0xf210a9075089fb55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fb5c expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217113.722476:0:14797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664485880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14797:1868789734008576:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782217113.722513:0:14797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217113.722661:0:14797:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e67a3f06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782217113.722706:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734008576 00000100:00100000:2.0:1782217113.722712:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734008576 00000100:00100000:2.0:1782217113.722813:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782217113.722823:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6434db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+12:14797:x1868789734008576:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782217113.723012:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6434db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+12:14797:x1868789734008576:12345-0@lo:501:mount.lustre.0 Request processed in 190us (498us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782217113.723020:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782217113.723100:0:14797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664485880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14797:1868789734008576:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1782217113.723114:0:14797:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.119@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1782217113.723261:0:14797:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.119@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1782217113.723268:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67fd06c00/0xf210a9075089fb55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fb5c expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217113.723277:0:14797:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e67fd06c00/0xf210a9075089fb55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fb5c expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782217113.723298:0:14797:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88e643535000 10000000:01000000:1.0:1782217113.723303:0:14797:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1782217113.723307:0:14797:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff88e67a633380 10000000:01000000:1.0:1782217113.723309:0:14797:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1782217113.723312:0:14797:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff88e67a633380 from 1 10000000:01000000:1.0:1782217113.723315:0:14797:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782217113.723338:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67fd06a00/0xf210a9075089fc6d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217113.723345:0:14797:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e67fd06a00/0xf210a9075089fc6d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217113.723353:0:14797:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e67fd06a00/0xf210a9075089fc6d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217113.723376:0:14797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664485880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14797:1868789734008704:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782217113.723401:0:14797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217113.723733:0:14797:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e67a3f06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782217113.723814:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734008704 00000100:00100000:0.0:1782217113.723819:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734008704 00000100:00100000:0.0:1782217113.723843:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782217113.723849:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6434d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+12:14797:x1868789734008704:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782217113.723858:0:14157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217113.723871:0:14157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e67437b000/0xf210a9075089fc74 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089fc6d expref: -99 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217113.723903:0:14157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e67437b000/0xf210a9075089fc74 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089fc6d expref: 13 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217113.723913:0:14157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e67437b000/0xf210a9075089fc74 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089fc6d expref: 13 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217113.723921:0:14157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437b000, rc 0) 00000100:00100000:0.0:1782217113.723958:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6434d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+13:14797:x1868789734008704:12345-0@lo:101:mount.lustre.0 Request processed in 109us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217113.723972:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782217113.724050:0:14797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664485880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14797:1868789734008704:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782217113.724063:0:14797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e67fd06a00/0xf210a9075089fc6d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fc74 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217113.724071:0:14797:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e67fd06a00/0xf210a9075089fc6d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089fc74 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782217113.724102:0:14797:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782217113.724118:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67fd06a00/0xf210a9075089fc6d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fc74 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217113.724125:0:14797:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e67fd06a00/0xf210a9075089fc6d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fc74 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782217113.724131:0:14797:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1782217113.724136:0:14797:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782217113.724140:0:14797:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1782217113.724142:0:14797:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1782217113.724155:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67fd07600/0xf210a9075089fc7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217113.724161:0:14797:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e67fd07600/0xf210a9075089fc7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217113.724168:0:14797:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e67fd07600/0xf210a9075089fc7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217113.724186:0:14797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664485880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14797:1868789734008832:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782217113.724211:0:14797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217113.724228:0:14797:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e67a3f06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782217113.724407:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734008832 00000100:00100000:0.0:1782217113.724411:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734008832 00000100:00100000:0.0:1782217113.724429:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782217113.724435:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6434d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+13:14797:x1868789734008832:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782217113.724442:0:14157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217113.724449:0:14157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e67437a600/0xf210a9075089fc82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089fc7b expref: -99 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217113.724462:0:14157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e67437a600/0xf210a9075089fc82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089fc7b expref: 14 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217113.724470:0:14157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e67437a600/0xf210a9075089fc82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089fc7b expref: 14 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217113.724476:0:14157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437a600, rc 0) 00000100:00100000:0.0:1782217113.724508:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6434d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+14:14797:x1868789734008832:12345-0@lo:101:mount.lustre.0 Request processed in 73us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217113.724514:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782217113.724723:0:14797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664485880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14797:1868789734008832:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782217113.724734:0:14797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e67fd07600/0xf210a9075089fc7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fc82 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217113.724740:0:14797:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e67fd07600/0xf210a9075089fc7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089fc82 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782217113.725800:0:14797:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1782217113.727210:0:14797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782217113.727434:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1782217113.727476:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1782217113.727507:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1782217113.727690:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1782217113.727727:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1782217113.727761:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1782217113.727824:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1782217113.727832:0:14797:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1782217113.727925:0:14797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664485880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14797:1868789734008960:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782217113.727986:0:14797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217113.728027:0:14797:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e67a3f0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782217113.728195:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734008960 00000100:00100000:0.0:1782217113.728202:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734008960 00000100:00100000:0.0:1782217113.728248:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1782217113.728256:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6434da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+14:14797:x1868789734008960:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782217113.728603:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6434da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+14:14797:x1868789734008960:12345-0@lo:501:mount.lustre.0 Request processed in 346us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217113.728611:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782217113.728798:0:14797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664485880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14797:1868789734008960:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782217113.728830:0:14797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664485880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14797:1868789734009088:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782217113.728867:0:14797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217113.728932:0:14797:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e67a3f0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782217113.728979:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734009088 00000100:00100000:2.0:1782217113.728984:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734009088 00000100:00100000:2.0:1782217113.729007:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1782217113.729015:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6434d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+14:14797:x1868789734009088:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782217113.729304:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6434d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+14:14797:x1868789734009088:12345-0@lo:503:mount.lustre.0 Request processed in 290us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217113.729312:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782217113.729422:0:14797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664485880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14797:1868789734009088:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1782217113.730069:0:14797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782217113.730134:0:14797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664485880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14797:1868789734009216:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782217113.730173:0:14797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217113.730194:0:14797:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e67a3f0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782217113.730401:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734009216 00000100:00100000:2.0:1782217113.730406:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734009216 00000100:00100000:2.0:1782217113.730450:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782217113.730458:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6434d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+14:14797:x1868789734009216:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782217113.730651:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6434d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+14:14797:x1868789734009216:12345-0@lo:502:mount.lustre.0 Request processed in 193us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217113.730658:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782217113.730822:0:14797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664485880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14797:1868789734009216:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782217113.731066:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1782217113.731255:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1782217113.731293:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1782217113.731354:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1782217113.731392:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1782217113.731427:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1782217113.731473:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1782217113.731510:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1782217113.731621:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1782217113.731684:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1782217113.731718:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1782217113.731765:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1782217113.731795:0:14797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664485880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14797:1868789734009344:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782217113.731843:0:14797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217113.731917:0:14797:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e67a3f0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782217113.732225:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734009344 00000100:00100000:2.0:1782217113.732230:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734009344 00000100:00100000:2.0:1782217113.732313:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782217113.732322:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6434d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+14:14797:x1868789734009344:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782217113.732494:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6434d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+14:14797:x1868789734009344:12345-0@lo:502:mount.lustre.0 Request processed in 172us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217113.732501:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1782217113.732577:0:14797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664485880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14797:1868789734009344:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782217113.732651:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1782217113.732662:0:14797:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1782217113.733827:0:14812:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1782217113.733837:0:14812:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1782217113.733843:0:14812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782217113.733853:0:14812:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1782217113.733858:0:14812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782217113.733872:0:14812:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff88e6745f0000) 00000020:00000080:1.0:1782217113.733947:0:14812:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1782217113.733954:0:14812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1782217113.734024:0:14812:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88e643535000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1782217113.734031:0:14812:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1782217113.734037:0:14812:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf210a9075089fc90 00010000:00010000:1.0:1782217113.738215:0:14812:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1782217113.738664:0:14812:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1782217113.740338:0:14812:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1782217113.742077:0:14812:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1782217113.742223:0:14812:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782217113.742231:0:14812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782217113.742233:0:14812:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1782217113.742238:0:14812:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1782217113.742240:0:14812:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1782217113.742242:0:14812:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1782217113.742251:0:14812:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1782217113.742253:0:14812:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1782217113.742255:0:14812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782217113.742257:0:14812:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1782217113.742259:0:14812:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782217113.742262:0:14812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782217113.742263:0:14812:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1782217113.742266:0:14812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1782217113.742268:0:14812:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1782217113.742271:0:14812:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782217113.742273:0:14812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782217113.742275:0:14812:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1782217113.742277:0:14812:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782217113.742279:0:14812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782217113.742280:0:14812:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1782217113.742284:0:14812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1782217113.742340:0:14812:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782217113.742343:0:14812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782217113.742344:0:14812:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1782217113.742347:0:14812:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1782217113.744654:0:14797:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1782217113.744692:0:14797:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1782217113.744716:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67fd07600/0xf210a9075089fc7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fc82 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217113.744729:0:14797:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e67fd07600/0xf210a9075089fc7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fc82 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782217113.744737:0:14797:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff88e643535000 from 1 10000000:01000000:1.0:1782217113.744740:0:14797:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782217113.744776:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67fd06800/0xf210a9075089fc97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217113.744784:0:14797:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e67fd06800/0xf210a9075089fc97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217113.744793:0:14797:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e67fd06800/0xf210a9075089fc97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217113.744815:0:14797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664485880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14797:1868789734009472:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782217113.745316:0:14797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217113.745390:0:14797:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e652c809c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782217113.746304:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734009472 00000100:00100000:3.0:1782217113.746313:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734009472 00000100:00100000:3.0:1782217113.746359:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1782217113.746376:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6434db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+14:14797:x1868789734009472:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782217113.746458:0:14155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217113.746473:0:14155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e682170800/0xf210a9075089fc9e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089fc97 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217113.746560:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e682170800/0xf210a9075089fc9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089fc97 expref: 15 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217113.746571:0:14155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e682170800/0xf210a9075089fc9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089fc97 expref: 15 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217113.746579:0:14155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e682170800, rc 0) 00000100:00100000:3.0:1782217113.746643:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6434db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+15:14797:x1868789734009472:12345-0@lo:101:mount.lustre.0 Request processed in 269us (1327us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217113.746650:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782217113.749362:0:14797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664485880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14797:1868789734009472:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782217113.749388:0:14797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e67fd06800/0xf210a9075089fc97 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fc9e expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217113.749400:0:14797:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e67fd06800/0xf210a9075089fc97 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089fc9e expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782217113.749897:0:14797:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1782217113.750132:0:14797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782217113.750317:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1782217113.750351:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1782217113.750397:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1782217113.750403:0:14797:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1782217113.750453:0:14797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664485880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14797:1868789734009600:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782217113.750505:0:14797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217113.750536:0:14797:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e652c809c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782217113.750773:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734009600 00000100:00100000:0.0:1782217113.750792:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734009600 00000100:00100000:0.0:1782217113.750840:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1782217113.750849:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6434da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+15:14797:x1868789734009600:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782217113.751060:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6434da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+15:14797:x1868789734009600:12345-0@lo:501:mount.lustre.0 Request processed in 212us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217113.751067:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782217113.751217:0:14797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664485880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14797:1868789734009600:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782217113.751245:0:14797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664485880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14797:1868789734009728:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782217113.751280:0:14797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217113.751296:0:14797:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e652c809c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782217113.751346:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734009728 00000100:00100000:3.0:1782217113.751351:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734009728 00000100:00100000:3.0:1782217113.751378:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782217113.751384:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6434da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+15:14797:x1868789734009728:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782217113.751511:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6434da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+15:14797:x1868789734009728:12345-0@lo:503:mount.lustre.0 Request processed in 127us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217113.751518:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782217113.751869:0:14797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664485880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14797:1868789734009728:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1782217113.756519:0:14797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782217113.757197:0:14797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664485880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14797:1868789734009856:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782217113.757269:0:14797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217113.757314:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734009856 00000100:00100000:1.0:1782217113.757322:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734009856 00000100:00100000:1.0:1782217113.757358:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1782217113.757366:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6434d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+15:14797:x1868789734009856:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782217113.757766:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6434d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+15:14797:x1868789734009856:12345-0@lo:502:mount.lustre.0 Request processed in 166us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217113.757776:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1782217113.757820:0:14797:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e652c809c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782217113.757838:0:14797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664485880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14797:1868789734009856:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782217113.759705:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1782217113.759774:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1782217113.759815:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1782217113.759845:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1782217113.759871:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1782217113.760953:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1782217113.761048:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1782217113.761079:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1782217113.761298:0:14797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664485880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14797:1868789734009984:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782217113.761371:0:14797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217113.761412:0:14797:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e652c809c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782217113.761482:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734009984 00000100:00100000:3.0:1782217113.761490:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734009984 00000100:00100000:3.0:1782217113.761535:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1782217113.761544:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6434db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+15:14797:x1868789734009984:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782217113.762362:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6434db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+15:14797:x1868789734009984:12345-0@lo:502:mount.lustre.0 Request processed in 816us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217113.762383:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1782217113.765274:0:14797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664485880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14797:1868789734009984:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782217113.765447:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1782217113.765461:0:14797:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1782217113.766536:0:14816:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782217113.766546:0:14816:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782217113.766548:0:14816:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1782217113.766555:0:14816:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff88e643535000 00000020:00000080:2.0:1782217113.766558:0:14816:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1782217113.766564:0:14816:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782217113.766566:0:14816:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782217113.766567:0:14816:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1782217113.766569:0:14816:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782217113.766571:0:14816:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782217113.766572:0:14816:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1782217113.766575:0:14816:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff88e643535000 00000020:00000080:2.0:1782217113.766577:0:14816:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1782217113.766641:0:14816:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782217113.766644:0:14816:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782217113.766651:0:14816:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1782217113.766654:0:14816:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782217113.766656:0:14816:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782217113.766658:0:14816:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1782217113.766660:0:14816:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88e643535000 00000020:00000080:2.0:1782217113.766672:0:14816:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1782217113.766709:0:14816:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782217113.766713:0:14816:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782217113.766714:0:14816:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1782217113.766717:0:14816:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1782217113.768214:0:14797:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1782217113.768243:0:14797:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782217113.768267:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67fd06800/0xf210a9075089fc97 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fc9e expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217113.768290:0:14797:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e67fd06800/0xf210a9075089fc97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fc9e expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782217113.768329:0:14797:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1782217113.768332:0:14797:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88e643535000 10000000:01000000:1.0:1782217113.768335:0:14797:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88e643535000 10000000:01000000:1.0:1782217113.768338:0:14797:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782217113.768343:0:14797:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff88e643535000 from 1 10000000:01000000:1.0:1782217113.768345:0:14797:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782217113.768375:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67fd06000/0xf210a9075089fca5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217113.768383:0:14797:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e67fd06000/0xf210a9075089fca5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217113.768393:0:14797:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e67fd06000/0xf210a9075089fca5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217113.768416:0:14797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664485880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14797:1868789734010112:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782217113.768478:0:14797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217113.768520:0:14797:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e652c80180 going to sleep for 11 seconds 00000100:00100000:2.0:1782217113.769266:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734010112 00000100:00100000:2.0:1782217113.769275:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734010112 00000100:00100000:2.0:1782217113.769317:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782217113.769325:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6434dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+15:14797:x1868789734010112:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782217113.769338:0:14155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217113.769351:0:14155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e6738ae800/0xf210a9075089fcac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089fca5 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217113.769374:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e6738ae800/0xf210a9075089fcac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089fca5 expref: 16 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217113.769384:0:14155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e6738ae800/0xf210a9075089fcac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089fca5 expref: 16 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217113.769638:0:14155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738ae800, rc 0) 00000100:00100000:2.0:1782217113.769702:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6434dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+16:14797:x1868789734010112:12345-0@lo:101:mount.lustre.0 Request processed in 376us (1224us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217113.769709:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1782217113.772333:0:14797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664485880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14797:1868789734010112:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782217113.772361:0:14797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e67fd06000/0xf210a9075089fca5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fcac expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217113.772373:0:14797:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e67fd06000/0xf210a9075089fca5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089fcac expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782217113.772985:0:14797:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1782217113.773277:0:14797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782217113.773500:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1782217113.773548:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1782217113.773613:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1782217113.773660:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1782217113.773696:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1782217113.773743:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1782217113.773778:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1782217113.773809:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1782217113.773849:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1782217113.773904:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1782217113.773940:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1782217113.773985:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1782217113.774025:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1782217113.774059:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1782217113.774103:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1782217113.774135:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1782217113.774167:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1782217113.774212:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1782217113.774262:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1782217113.774298:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1782217113.774341:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1782217113.774374:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1782217113.774404:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1782217113.774450:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1782217113.774485:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1782217113.774517:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1782217113.774572:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1782217113.774622:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1782217113.774691:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1782217113.774707:0:14797:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1782217113.774789:0:14797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664485880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14797:1868789734010240:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782217113.774850:0:14797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217113.774919:0:14797:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e652c80180 going to sleep for 11 seconds 00000100:00100000:2.0:1782217113.776188:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734010240 00000100:00100000:2.0:1782217113.776197:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734010240 00000100:00100000:2.0:1782217113.776245:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782217113.776260:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6434dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+16:14797:x1868789734010240:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782217113.776516:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6434dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+16:14797:x1868789734010240:12345-0@lo:501:mount.lustre.0 Request processed in 256us (1665us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217113.776523:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1782217113.782381:0:14797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664485880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14797:1868789734010240:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782217113.782442:0:14797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664485880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14797:1868789734010368:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782217113.783417:0:14797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217113.783504:0:14797:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e652c80180 going to sleep for 11 seconds 00000100:00100000:0.0:1782217113.786102:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734010368 00000100:00100000:0.0:1782217113.786115:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734010368 00000100:00100000:0.0:1782217113.786170:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1782217113.786180:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6446d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+16:14797:x1868789734010368:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782217113.792961:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6446d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+16:14797:x1868789734010368:12345-0@lo:503:mount.lustre.0 Request processed in 6773us (9537us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217113.792976:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1782217113.793147:0:14797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664485880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14797:1868789734010368:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1782217113.793839:0:14797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782217113.793958:0:14797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664485880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14797:1868789734010496:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782217113.794021:0:14797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217113.794062:0:14797:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e652c80180 going to sleep for 11 seconds 00000100:00100000:0.0:1782217113.794187:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734010496 00000100:00100000:0.0:1782217113.794193:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734010496 00000100:00100000:0.0:1782217113.794239:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1782217113.794247:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6446d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+16:14797:x1868789734010496:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782217113.794517:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6446d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+16:14797:x1868789734010496:12345-0@lo:502:mount.lustre.0 Request processed in 269us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217113.794524:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1782217113.794723:0:14797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664485880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14797:1868789734010496:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782217113.794977:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1782217113.795024:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1782217113.795069:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1782217113.795207:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1782217113.795246:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1782217113.795296:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1782217113.795330:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1782217113.795362:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1782217113.795407:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1782217113.795442:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1782217113.795476:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1782217113.796263:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1782217113.796302:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1782217113.796347:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1782217113.796396:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1782217113.796432:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1782217113.796464:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1782217113.797244:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1782217113.797307:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1782217113.797342:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1782217113.797391:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1782217113.797426:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1782217113.797458:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1782217113.801791:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1782217113.801893:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1782217113.801929:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1782217113.801968:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1782217113.801996:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1782217113.802022:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1782217113.802060:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1782217113.802248:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1782217113.802294:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1782217113.802349:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1782217113.802411:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1782217113.802447:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1782217113.802492:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1782217113.802529:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1782217113.802564:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1782217113.802625:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1782217113.802658:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1782217113.802715:0:14797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14797:1868789734010624:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782217113.802781:0:14797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217113.802819:0:14797:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e652abb840 going to sleep for 11 seconds 00000100:00100000:2.0:1782217113.803027:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734010624 00000100:00100000:2.0:1782217113.803034:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734010624 00000100:00100000:2.0:1782217113.803072:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1782217113.803079:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6446d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+16:14797:x1868789734010624:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782217113.803296:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6446d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+16:14797:x1868789734010624:12345-0@lo:502:mount.lustre.0 Request processed in 215us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217113.803308:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1782217113.803354:0:14797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14797:1868789734010624:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1782217113.803411:0:14797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1782217113.803420:0:14797:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1782217113.808618:0:14821:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1782217113.808634:0:14821:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff88e674218000) 00000020:00000080:3.0:1782217113.808653:0:14821:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1782217113.808796:0:14821:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88e643535000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1782217113.808801:0:14821:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88e643535000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1782217113.808803:0:14821:0:(obd_mount.c:701:lustre_put_lsi()) put ffff88e643535000 3 00010000:00080000:3.0:1782217113.808830:0:14821:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88e643532000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.119@tcp at head 00010000:00010000:3.0:1782217113.811005:0:14821:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1782217113.811096:0:14821:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1782217113.811130:0:14821:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1782217113.811153:0:14821:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf210a9075089fcba 00000100:00080000:3.0:1782217113.811164:0:14821:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782217113.811169:0:14821:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff88e643532000 using connection 192.168.203.119@tcp/0@lo 00000100:00100000:3.0:1782217113.811201:0:14821:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88e67420f100 x1868789734010752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782217113.811231:0:14821:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1782217113.811326:0:3300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67420f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3300:1868789734010752:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1782217113.811389:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217113.811446:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734010752 00000100:00100000:2.0:1782217113.811452:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734010752 00000100:00100000:2.0:1782217113.811477:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782217113.811484:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3300:x1868789734010752:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1782217113.811504:0:14162:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 432 last 0 00000020:00000080:2.0:1782217113.811531:0:14162:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf210a9075089fcc1 00000004:00100000:2.0:1782217113.811543:0:14162:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1782217113.811566:0:14162:0:(import.c:65:import_set_state_nolock()) ffff88e67f2d5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782217113.811621:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1868789734010752:12345-0@lo:38:llog_process_th.0 Request processed in 136us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217113.811629:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1782217113.811662:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88e67420f100 x1868789734010752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782217123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217113.811673:0:3300:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782217113.811680:0:3300:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1782217113.811685:0:3300:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1782217113.811689:0:3300:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1782217113.811691:0:3300:0:(import.c:65:import_set_state_nolock()) ffff88e643532000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1782217113.811697:0:3300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67420f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3300:1868789734010752:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1782217113.812064:0:14821:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1782217113.812105:0:14797:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1782217113.812128:0:14797:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782217113.812143:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67fd06000/0xf210a9075089fca5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fcac expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217113.812154:0:14797:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e67fd06000/0xf210a9075089fca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fcac expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1782217113.812194:0:14797:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1782217113.812196:0:14797:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782217113.812197:0:14797:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782217113.812199:0:14797:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782217113.812200:0:14797:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782217113.812201:0:14797:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782217113.812203:0:14797:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782217113.812205:0:14797:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782217113.812206:0:14797:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782217113.812210:0:14797:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1782217113.812212:0:14797:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782217113.812214:0:14797:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782217113.812215:0:14797:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782217113.812216:0:14797:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782217113.812218:0:14797:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782217113.812219:0:14797:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782217113.812220:0:14797:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782217113.812221:0:14797:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782217113.812222:0:14797:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782217113.812238:0:14797:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1782217113.812251:0:14797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14797:1868789734010880:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1782217113.812287:0:14797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217113.812312:0:14797:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64e3800c0 going to sleep for 11 seconds 00000100:00080000:1.0:1782217113.812519:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782217113.812525:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1782217113.812527:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782217113.812531:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1782217113.812578:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868789734011008:0@lo:400:kworker.0 00000100:00100000:3.0:1782217113.812617:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217113.812672:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734010880 00000100:00100000:1.0:1782217113.812677:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734010880 00000100:00100000:1.0:1782217113.812711:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1782217113.812719:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6446d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+16:14797:x1868789734010880:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1782217113.812741:0:14156:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1782217113.812754:0:14156:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1782217113.813180:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734011008 00000100:00100000:2.0:1782217113.813185:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734011008 00000100:00100000:2.0:1782217113.813220:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782217113.813231:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67420ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868789734011008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217113.813331:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67420ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868789734011008:12345-0@lo:400:kworker.0 Request processed in 104us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217113.813338:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1782217113.813393:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88e664485880 x1868789734011008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217113.813407:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868789734011008:0@lo:400:kworker.0 20000000:01000000:1.0:1782217113.846849:0:14156:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1782217113.846867:0:14156:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1782217113.846986:0:14178:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1782217113.846992:0:14178:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1782217113.847012:0:14178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88e6738afe00/0xf210a9075089fcc8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217113.847030:0:14178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88e682171400/0xf210a9075089fc35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089fc2e expref: 16 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217113.847039:0:14178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88e6738afe00/0xf210a9075089fcc8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217113.847073:0:14178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88e682171400/0xf210a9075089fc35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf210a9075089fc2e expref: 16 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217113.847101:0:14178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88e682171400/0xf210a9075089fc35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf210a9075089fc2e expref: 16 pid: 14155 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217113.847115:0:14178:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a2680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14178:1868789734011136:0@lo:104: 00000100:00100000:2.0:1782217113.847171:0:14178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217113.847202:0:14178:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64e380240 going to sleep for 11 seconds 00000100:00100000:1.0:1782217113.847470:0:14147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734011136 00000100:00100000:1.0:1782217113.847478:0:14147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734011136 00000100:00100000:1.0:1782217113.847540:0:14147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782217113.847549:0:14147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:713996b4-9a75-4cc4-875d-de8926ad5952+3:14178:x1868789734011136:12345-0@lo:104: 00010000:00010000:1.0:1782217113.847563:0:14147:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.119@tcp lock: ffff88e6738afa00/0xf210a9075089fc2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089fc35 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217113.847640:0:14147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782217113.847647:0:14147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:713996b4-9a75-4cc4-875d-de8926ad5952+3:14178:x1868789734011136:12345-0@lo:104: Request processed in 99us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217113.847654:0:14147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1782217113.847676:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782217113.847681:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e6738afa00/0xf210a9075089fc2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089fc35 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217113.847687:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738afa00 already unused, calling callback (ffffffffc1d2fc20) 10000000:00010000:1.0:1782217113.847691:0:14151:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e6738afa00/0xf210a9075089fc2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf210a9075089fc35 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217113.847699:0:14151:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e6738afa00/0xf210a9075089fc2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf210a9075089fc35 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782217113.847706:0:14151:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e6738afa00/0xf210a9075089fc2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf210a9075089fc35 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782217113.847712:0:14151:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1782217113.847737:0:14151:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: ffff88e6738afa00/0xf210a9075089fc2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089fc35 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217113.847743:0:14151:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782217113.847763:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e6738afa00/0xf210a9075089fc2e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089fc35 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217113.847770:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e6738afa00/0xf210a9075089fc2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089fc35 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217113.847795:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217113.847796:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217113.847798:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782217113.847809:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664485c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:713996b4-9a75-4cc4-875d-de8926ad5952:3304:1868789734011264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782217113.847836:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217113.847869:0:14150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734011264 00000100:00100000:1.0:1782217113.847873:0:14150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734011264 00010000:00010000:1.0:1782217113.847912:0:14150:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88e682171400/0xf210a9075089fc35 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089fc2e expref: 17 pid: 14155 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217113.847930:0:14150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782217113.847936:0:14150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664484000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:713996b4-9a75-4cc4-875d-de8926ad5952+17:3304:x1868789734011264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782217113.847944:0:14150:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217113.847949:0:14150:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88e682171400/0xf210a9075089fc35 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089fc2e expref: 17 pid: 14155 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217113.847959:0:14150:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88e682171400/0xf210a9075089fc35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf210a9075089fc2e expref: 17 pid: 14155 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217113.847973:0:14150:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88e6738afe00/0xf210a9075089fcc8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217113.847980:0:14150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e6738afe00/0xf210a9075089fcc8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782217113.847992:0:14150:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002678396s 00010000:00010000:1.0:1782217113.847996:0:14150:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88e6738afe00/0xf210a9075089fcc8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217113.848012:0:14150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88e6738afe00/0xf210a9075089fcc8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217113.848019:0:14150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88e6738afe00/0xf210a9075089fcc8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217113.848024:0:14150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88e6738afe00/0xf210a9075089fcc8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217113.848030:0:14150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e6738afe00 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:1.0:1782217113.848034:0:14150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88e6738afe00/0xf210a9075089fcc8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217113.848041:0:14150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88e6738afe00/0xf210a9075089fcc8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217113.848050:0:14150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88e6738afe00/0xf210a9075089fcc8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217113.848058:0:14150:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782217113.848242:0:14178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e682171400/0xf210a9075089fc35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf210a9075089fc2e expref: 17 pid: 14155 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217113.848254:0:14178:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a2680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14178:1868789734011136:0@lo:104: 00010000:00010000:2.0:1782217113.848273:0:14178:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88e6738afe00/0xf210a9075089fcc8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217113.848288:0:14178:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88e6738afe00/0xf210a9075089fcc8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217113.848295:0:14178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88e6738afe00/0xf210a9075089fcc8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217113.848301:0:14178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e6738afe00/0xf210a9075089fcc8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217113.848405:0:14150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664484000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:713996b4-9a75-4cc4-875d-de8926ad5952+16:3304:x1868789734011264:12345-0@lo:103:ldlm_bl.0 Request processed in 468us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217113.848413:0:14150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782217113.848442:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664485c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:713996b4-9a75-4cc4-875d-de8926ad5952:3304:1868789734011264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782217113.855969:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6446d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+15:14797:x1868789734010880:12345-0@lo:253:mount.lustre.0 Request processed in 43242us (43673us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217113.855983:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1782217113.856135:0:14797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:14797:1868789734010880:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1782217113.856152:0:14797:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1782217113.856155:0:14797:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782217113.856156:0:14797:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782217113.856158:0:14797:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782217113.856159:0:14797:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782217113.856160:0:14797:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782217113.856161:0:14797:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782217113.856163:0:14797:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782217113.856164:0:14797:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782217113.856166:0:14797:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1782217113.856184:0:14797:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1782217113.861104:0:14797:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1782217113.861303:0:14797:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1782217113.861473:0:14797:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1782217113.861650:0:14797:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1782217113.861791:0:14797:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1782217113.862189:0:14797:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1782217113.862959:0:14797:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1782217113.903901:0:14797:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1782217113.903910:0:14797:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1782217113.903939:0:14797:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1782217113.903987:0:14797:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.119@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1782217113.904005:0:14797:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1782217113.904041:0:14797:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1782217114.068038:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217115.096647:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782217115.417627:0:14160:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1782217115.417636:0:14160:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff88e652461000 from 7 10000000:01000000:0.0:1782217115.417649:0:14160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1782217115.417694:0:14160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67437b600/0xf210a9075089fccf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217115.417717:0:14160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e67437b600/0xf210a9075089fccf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217115.417729:0:14160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e67437b600/0xf210a9075089fccf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217115.417756:0:14160:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f79ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:713996b4-9a75-4cc4-875d-de8926ad5952:14160:1868789734011392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782217115.417819:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217115.417872:0:14160:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e652c80d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782217115.418413:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734011392 00000100:00100000:2.0:1782217115.418422:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734011392 00000100:00100000:2.0:1782217115.418480:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1782217115.418490:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6446d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+15:14160:x1868789734011392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782217115.418506:0:14155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217115.418520:0:14155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e6738aea00/0xf210a9075089fcd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089fccf expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217115.418545:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e6738aea00/0xf210a9075089fcd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089fccf expref: 16 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217115.418556:0:14155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e6738aea00/0xf210a9075089fcd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089fccf expref: 16 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217115.418566:0:14155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738aea00, rc 0) 00000100:00100000:2.0:1782217115.418625:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6446d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+16:14160:x1868789734011392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217115.418633:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1782217115.418865:0:14160:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f79ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:713996b4-9a75-4cc4-875d-de8926ad5952:14160:1868789734011392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782217115.418900:0:14160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e67437b600/0xf210a9075089fccf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fcd6 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217115.418910:0:14160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e67437b600/0xf210a9075089fccf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089fcd6 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217115.418963:0:14160:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f79ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:713996b4-9a75-4cc4-875d-de8926ad5952:14160:1868789734011520:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1782217115.418996:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217115.419017:0:14160:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e652c80d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782217115.419069:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734011520 00000100:00100000:2.0:1782217115.419074:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734011520 00000100:00100000:2.0:1782217115.419102:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782217115.419108:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6446d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+16:14160:x1868789734011520:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1782217115.419121:0:14156:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1782217115.419136:0:14156:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1782217115.419139:0:14156:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1782217115.419222:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6446d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+16:14160:x1868789734011520:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 113us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217115.419229:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1782217115.419349:0:14160:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f79ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:713996b4-9a75-4cc4-875d-de8926ad5952:14160:1868789734011520:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1782217115.419411:0:14160:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782217115.419418:0:14160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67437b600/0xf210a9075089fccf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fcd6 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217115.419426:0:14160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e67437b600/0xf210a9075089fccf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fcd6 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217116.116017:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217117.172406:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217118.236670:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782217119.196263:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782217119.196270:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782217119.196285:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782217119.196289:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1782217119.196378:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67420c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1868789734011904:0@lo:400:kworker.0 00000100:00100000:3.0:1782217119.196446:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217119.196647:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67420f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:713996b4-9a75-4cc4-875d-de8926ad5952:3301:1868789734011648:0@lo:400:kworker.0 00000100:00100000:1.0:1782217119.196681:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217119.196705:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782217119.196712:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67420dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789734011776:0@lo:400:kworker.0 00000100:00100000:1.0:1782217119.196754:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217119.196991:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734011904 00000100:00100000:2.0:1782217119.196998:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734011904 00000100:00100000:2.0:1782217119.197069:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734011776 00000100:00100000:2.0:1782217119.197072:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734011776 00000100:00100000:2.0:1782217119.197089:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782217119.197098:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67420ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868789734011904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217119.197151:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67420ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868789734011904:12345-0@lo:400:kworker.0 Request processed in 54us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217119.197158:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782217119.197174:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782217119.197180:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789734011776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217119.197212:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789734011776:12345-0@lo:400:kworker.0 Request processed in 32us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217119.197218:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782217119.197246:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734011648 00000100:00100000:2.0:1782217119.197250:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734011648 00000100:00100000:2.0:1782217119.197273:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782217119.197280:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6446d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+16:3301:x1868789734011648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217119.197309:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6446d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+16:3301:x1868789734011648:12345-0@lo:400:kworker.0 Request processed in 29us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217119.197315:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1782217119.197361:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88e67420dc00 x1868789734011776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217119.197373:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67420dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789734011776:0@lo:400:kworker.0 00000100:00100000:2.0:1782217119.197383:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67420f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:713996b4-9a75-4cc4-875d-de8926ad5952:3301:1868789734011648:0@lo:400:kworker.0 00010000:00080000:2.0:1782217119.197415:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88e67420c000 x1868789734011904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217119.197437:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67420c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1868789734011904:0@lo:400:kworker.0 00000100:00080000:3.0:1782217119.197847:0:14158:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782217119.252251:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217120.279740:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782217121.098083:0:15164:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg319-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1782217121.300156:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217122.326097:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782217122.644712:0:14196:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1782217123.351608:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782217124.308313:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782217124.308323:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782217124.308327:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782217124.308330:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1782217124.308386:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f79d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789734012160:0@lo:400:kworker.0 00000100:00100000:0.0:1782217124.308470:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217124.308549:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782217124.308555:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f79e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1868789734012288:0@lo:400:kworker.0 00000100:00100000:0.0:1782217124.308584:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217124.308624:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734012160 00000100:00100000:0.0:1782217124.308633:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734012160 00000100:00100000:0.0:1782217124.308684:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734012288 00000100:00100000:0.0:1782217124.308688:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734012288 00000100:00100000:0.0:1782217124.308719:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782217124.308728:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f79e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789734012160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217124.308792:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f79e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789734012160:12345-0@lo:400:kworker.0 Request processed in 64us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217124.308800:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782217124.308820:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782217124.308826:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f79ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1868789734012288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217124.308852:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f79ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1868789734012288:12345-0@lo:400:kworker.0 Request processed in 27us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217124.308857:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1782217124.308917:0:14158:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1782217124.308964:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88e67f79e680 x1868789734012288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782217124.308980:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f79e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1868789734012288:0@lo:400:kworker.0 00010000:00080000:0.0:1782217124.308992:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88e67f79d500 x1868789734012160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782217124.308999:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f79d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789734012160:0@lo:400:kworker.0 00000100:00100000:1.0:1782217124.309126:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782217124.309139:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f79ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:713996b4-9a75-4cc4-875d-de8926ad5952:3303:1868789734012032:0@lo:400:kworker.0 00000100:00100000:1.0:1782217124.309180:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217124.310042:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734012032 00000100:00100000:3.0:1782217124.310053:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734012032 00000100:00100000:3.0:1782217124.310101:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1782217124.310110:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6446d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+16:3303:x1868789734012032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217124.310176:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6446d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+16:3303:x1868789734012032:12345-0@lo:400:kworker.0 Request processed in 67us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217124.310183:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1782217124.310232:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f79ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:713996b4-9a75-4cc4-875d-de8926ad5952:3303:1868789734012032:0@lo:400:kworker.0 00010000:00010000:1.0:1782217124.372258:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217125.078458:0:3300:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782217110/real 1782217110] req@ffff88e67f79f800 x1868789734008064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782217125 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217125.078516:0:3300:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88e67f79f800 x1868789734008064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782217125 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217125.078528:0:3300:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782217110/real 1782217110] req@ffff88e67f79df80 x1868789734008192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782217125 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217125.078541:0:3300:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88e67f79df80 x1868789734008192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782217125 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1782217125.078581:0:3300:0:(import.c:65:import_set_state_nolock()) ffff88e67418a000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782217125.078609:0:3300:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1782217125.078613:0:3300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f79f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1868789734008064:0@lo:8:kworker.0 00000100:00080000:3.0:1782217125.078620:0:3300:0:(import.c:65:import_set_state_nolock()) ffff88e650a33000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782217125.078627:0:3300:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1782217125.078630:0:3300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f79df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1868789734008192:0@lo:8:kworker.0 00000100:00100000:0.0:1782217125.079084:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:2.0:1782217125.079101:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782217125.079111:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1782217125.079115:0:38:0:(import.c:65:import_set_state_nolock()) ffff88e67418a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782217125.079122:0:38:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 429 00000100:00080000:2.0:1782217125.079129:0:38:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1782217125.079138:0:38:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff88e67418a000 using connection 192.168.203.119@tcp/0@lo 00000100:00100000:2.0:1782217125.079175:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88e64e2a2680 x1868789734012544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782217125.079183:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:713996b4-9a75-4cc4-875d-de8926ad5952:3304:1868789734012416:0@lo:400:kworker.0 00000100:00080000:2.0:1782217125.079194:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782217125.079197:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1782217125.079199:0:38:0:(import.c:65:import_set_state_nolock()) ffff88e650a33000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782217125.079203:0:38:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 429 00000100:00080000:2.0:1782217125.079205:0:38:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1782217125.079209:0:38:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88e650a33000 using connection 192.168.203.119@tcp/0@lo 00000100:00100000:2.0:1782217125.079220:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88e64e2a3480 x1868789734012672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782217125.079274:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217125.079305:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734012416 00000100:00100000:2.0:1782217125.079313:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734012416 00000100:00100000:0.0:1782217125.079338:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868789734012800:0@lo:400:kworker.0 00000100:00100000:2.0:1782217125.079362:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782217125.079368:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217125.079373:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6446d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+16:3304:x1868789734012416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217125.079403:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1868789734012928:0@lo:400:kworker.0 00000100:00100000:0.0:1782217125.079429:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217125.079434:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6446d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+16:3304:x1868789734012416:12345-0@lo:400:kworker.0 Request processed in 63us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217125.079453:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782217125.079463:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734012800 00000100:00100000:0.0:1782217125.079467:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734012800 00000100:00100000:0.0:1782217125.079495:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734012928 00000100:00100000:0.0:1782217125.079498:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734012928 00000100:00100000:2.0:1782217125.079514:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782217125.079522:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f79d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868789734012800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217125.079527:0:14163:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1782217125.079546:0:14163:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1782217125.079555:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f79d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868789734012800:12345-0@lo:400:kworker.0 Request processed in 34us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217125.079562:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782217125.079564:0:14164:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1782217125.079572:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782217125.079578:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f79e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1868789734012928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217125.079628:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f79e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1868789734012928:12345-0@lo:400:kworker.0 Request processed in 50us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217125.079635:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1782217125.079712:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88e64e2a1180 x1868789734012928/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217125.079724:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1868789734012928:0@lo:400:kworker.0 00010000:00080000:0.0:1782217125.079759:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88e64e2a3100 x1868789734012800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782217125.079777:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868789734012800:0@lo:400:kworker.0 00000100:00100000:0.0:1782217125.079801:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:713996b4-9a75-4cc4-875d-de8926ad5952:3304:1868789734012416:0@lo:400:kworker.0 00000100:00100000:3.0:1782217125.081066:0:3300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1868789734012544:0@lo:8:kworker.0 00000100:00100000:3.0:1782217125.081139:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217125.081194:0:3300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1868789734012672:0@lo:8:kworker.0 00000100:00100000:3.0:1782217125.081223:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217125.081269:0:14800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734012544 00000100:00100000:3.0:1782217125.081276:0:14800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734012544 00000100:00100000:3.0:1782217125.081308:0:14800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734012672 00000100:00100000:3.0:1782217125.081312:0:14800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734012672 00000100:00100000:3.0:1782217125.081326:0:14800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782217125.081333:0:14800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67420ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3300:x1868789734012544:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1782217125.081642:0:14800:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 444 last 0 00000020:00000080:3.0:1782217125.081682:0:14800:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf210a9075089fcdd 00002000:00100000:3.0:1782217125.081702:0:14800:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff88e6751e8800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1782217125.081707:0:14800:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1782217125.081711:0:14800:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1782217125.082997:0:14800:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1782217125.083111:0:14800:0:(import.c:65:import_set_state_nolock()) ffff88e6751eb000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782217125.083235:0:14800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67420ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3300:x1868789734012544:12345-0@lo:8:kworker.0 Request processed in 1898us (2093us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217125.083256:0:14800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782217125.083294:0:14800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782217125.083301:0:14800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67420fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3300:x1868789734012672:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1782217125.083320:0:14800:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1782217125.083801:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88e64e2a2680 x1868789734012544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782217145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217125.083816:0:3300:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782217125.083827:0:3300:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1782217125.083838:0:3300:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1782217125.083844:0:3300:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1782217125.083847:0:3300:0:(import.c:65:import_set_state_nolock()) ffff88e67418a000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1782217125.083913:0:3300:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1782217125.083921:0:3300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1868789734012544:0@lo:8:kworker.0 00000004:00080000:2.0:1782217125.084153:0:14184:0:(osp_sync.c:1060:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1782217125.084168:0:14185:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:0.0:1782217125.084196:0:14185:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f79d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14185:1868789734013184:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1782217125.084265:0:14185:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217125.084294:0:14185:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e650459300 going to sleep for 11 seconds 00000100:00100000:0.0:1782217125.084310:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f79fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789734013056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782217125.084344:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217125.084409:0:14802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734013056 00000100:00100000:0.0:1782217125.084417:0:14802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734013056 00000004:00080000:2.0:1782217125.084625:0:14184:0:(osp_sync.c:1862:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 444136746375ns, next at 0ns, rc = 0 00000100:00100000:0.0:1782217125.084797:0:14802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782217125.084807:0:14803:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1782217125.084812:0:14802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f79f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1868789734013056:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782217125.084819:0:14803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:0.0:1782217125.084853:0:14802:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782217125.085464:0:14802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f79f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1868789734013056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 655us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217125.085475:0:14802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1782217125.087118:0:14158:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782217125.087154:0:14798:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1782217125.087166:0:14798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:0.0:1782217125.088586:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88e67f79fb80 x1868789734013056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782217141 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782217125.088621:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f79fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789734013056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782217125.088708:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734013184 00000100:00100000:0.0:1782217125.088717:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734013184 00000100:00100000:0.0:1782217125.088860:0:15336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782217125.088873:0:15336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f79c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14185:x1868789734013184:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1782217125.105944:0:15336:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1782217125.105964:0:15336:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1782217125.105973:0:15336:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:0.0:1782217125.131773:0:15336:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782217125.131790:0:15336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f612072d/0xf210a9075089fce4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.131815:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1782217125.131819:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217125.131827:0:15336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f612072d/0xf210a9075089fce4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.131850:0:15336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f612072d/0xf210a9075089fce4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.131864:0:15336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f612072d/0xf210a9075089fce4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.131873:0:15336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f612072d/0xf210a9075089fce4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.131928:0:15336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1782217125.132458:0:15336:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782217125.132465:0:15336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4698b20/0xf210a9075089fceb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.132488:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1782217125.132492:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217125.132497:0:15336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4698b20/0xf210a9075089fceb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.132521:0:15336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4698b20/0xf210a9075089fceb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.132530:0:15336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4698b20/0xf210a9075089fceb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.132537:0:15336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4698b20/0xf210a9075089fceb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.132560:0:15336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1782217125.132579:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782217125.132585:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f612072d/0xf210a9075089fce4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.132595:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437a800 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:0.0:1782217125.132600:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f612072d/0xf210a9075089fce4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.132611:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f612072d/0xf210a9075089fce4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.132645:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f612072d/0xf210a9075089fce4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.132654:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f612072d/0xf210a9075089fce4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.132674:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782217125.132678:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4698b20/0xf210a9075089fceb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.132684:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437a200 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:0.0:1782217125.132688:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4698b20/0xf210a9075089fceb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.132697:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4698b20/0xf210a9075089fceb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.132706:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4698b20/0xf210a9075089fceb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.132713:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4698b20/0xf210a9075089fceb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.132726:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217125.132728:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217125.132735:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782217125.133207:0:15336:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782217125.133215:0:15336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c21c6b4/0xf210a9075089fcf2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.133224:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1782217125.133228:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217125.133232:0:15336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c21c6b4/0xf210a9075089fcf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.133242:0:15336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c21c6b4/0xf210a9075089fcf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.133250:0:15336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c21c6b4/0xf210a9075089fcf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.133258:0:15336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c21c6b4/0xf210a9075089fcf2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.133275:0:15336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782217125.133285:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782217125.133288:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c21c6b4/0xf210a9075089fcf2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.133295:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437be00 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:0.0:1782217125.133298:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c21c6b4/0xf210a9075089fcf2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.133319:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c21c6b4/0xf210a9075089fcf2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.133332:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c21c6b4/0xf210a9075089fcf2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.133339:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c21c6b4/0xf210a9075089fcf2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.133353:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217125.133355:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217125.133357:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782217125.133792:0:15336:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782217125.133798:0:15336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afb2944d/0xf210a9075089fcf9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.133807:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1782217125.133811:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217125.133815:0:15336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afb2944d/0xf210a9075089fcf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.133826:0:15336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afb2944d/0xf210a9075089fcf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.133834:0:15336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afb2944d/0xf210a9075089fcf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.133849:0:15336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afb2944d/0xf210a9075089fcf9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.133865:0:15336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782217125.133904:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782217125.133908:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afb2944d/0xf210a9075089fcf9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.133916:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437ac00 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:0.0:1782217125.133920:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afb2944d/0xf210a9075089fcf9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.133930:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afb2944d/0xf210a9075089fcf9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.133943:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afb2944d/0xf210a9075089fcf9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.133951:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afb2944d/0xf210a9075089fcf9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.133965:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217125.133966:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217125.133968:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782217125.134409:0:15336:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782217125.134423:0:15336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ddd7372/0xf210a9075089fd00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.134433:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1782217125.134436:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217125.134440:0:15336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ddd7372/0xf210a9075089fd00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.134450:0:15336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ddd7372/0xf210a9075089fd00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.134459:0:15336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ddd7372/0xf210a9075089fd00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.134466:0:15336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ddd7372/0xf210a9075089fd00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.134483:0:15336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782217125.134494:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782217125.134499:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ddd7372/0xf210a9075089fd00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.139575:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782217125.141706:0:15336:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217125.141722:0:15336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf568613/0xf210a9075089fd07 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.141744:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1782217125.141749:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217125.141757:0:15336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf568613/0xf210a9075089fd07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.141776:0:15336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf568613/0xf210a9075089fd07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.141797:0:15336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf568613/0xf210a9075089fd07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.141806:0:15336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf568613/0xf210a9075089fd07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.141834:0:15336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1782217125.142290:0:15336:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217125.142297:0:15336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024711dc6/0xf210a9075089fd0e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.142306:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1782217125.142310:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217125.142315:0:15336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024711dc6/0xf210a9075089fd0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.142325:0:15336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024711dc6/0xf210a9075089fd0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.142334:0:15336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024711dc6/0xf210a9075089fd0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.142341:0:15336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024711dc6/0xf210a9075089fd0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.142361:0:15336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1782217125.142773:0:15336:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217125.142780:0:15336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec35c3a2/0xf210a9075089fd15 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.142788:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1782217125.142791:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217125.142795:0:15336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec35c3a2/0xf210a9075089fd15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.142805:0:15336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec35c3a2/0xf210a9075089fd15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.142815:0:15336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec35c3a2/0xf210a9075089fd15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.142824:0:15336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec35c3a2/0xf210a9075089fd15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.142832:0:15336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1782217125.143280:0:15336:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217125.143288:0:15336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069c90b12/0xf210a9075089fd1c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.143297:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1782217125.143306:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217125.143310:0:15336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069c90b12/0xf210a9075089fd1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.143320:0:15336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069c90b12/0xf210a9075089fd1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.143329:0:15336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069c90b12/0xf210a9075089fd1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.143336:0:15336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069c90b12/0xf210a9075089fd1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.143344:0:15336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1782217125.143754:0:15336:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217125.143761:0:15336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f375ea8b/0xf210a9075089fd23 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.143770:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1782217125.143773:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217125.143777:0:15336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f375ea8b/0xf210a9075089fd23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.143787:0:15336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f375ea8b/0xf210a9075089fd23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.143796:0:15336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f375ea8b/0xf210a9075089fd23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.143811:0:15336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f375ea8b/0xf210a9075089fd23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.143820:0:15336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1782217125.144267:0:15336:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217125.144274:0:15336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c591218c/0xf210a9075089fd2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.144282:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1782217125.144285:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217125.144289:0:15336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c591218c/0xf210a9075089fd2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.144299:0:15336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c591218c/0xf210a9075089fd2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.144307:0:15336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c591218c/0xf210a9075089fd2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.144314:0:15336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c591218c/0xf210a9075089fd2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.144322:0:15336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:2.0:1782217125.145068:0:14800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67420fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3300:x1868789734012672:12345-0@lo:8:kworker.0 Request processed in 61756us (63834us total) trans 0 rc -19/-19 00000100:00100000:2.0:1782217125.145090:0:14800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1782217125.145158:0:3300:0:(import.c:65:import_set_state_nolock()) ffff88e650a33000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782217125.145164:0:3300:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1782217125.145177:0:3300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1868789734012672:0@lo:8:kworker.0 00010000:00010000:0.0:1782217125.145293:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437a400 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:0.0:1782217125.145300:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ddd7372/0xf210a9075089fd00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.145312:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ddd7372/0xf210a9075089fd00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.145344:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ddd7372/0xf210a9075089fd00 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.145351:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ddd7372/0xf210a9075089fd00 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.145394:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1782217125.145399:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf568613/0xf210a9075089fd07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.145406:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07200 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:0.0:1782217125.145409:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf568613/0xf210a9075089fd07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.145417:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf568613/0xf210a9075089fd07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.145428:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf568613/0xf210a9075089fd07 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.145436:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf568613/0xf210a9075089fd07 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.145449:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1782217125.145454:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024711dc6/0xf210a9075089fd0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.145469:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07800 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:0.0:1782217125.145473:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024711dc6/0xf210a9075089fd0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.145481:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024711dc6/0xf210a9075089fd0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.145492:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024711dc6/0xf210a9075089fd0e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.145499:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024711dc6/0xf210a9075089fd0e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.145524:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1782217125.145527:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec35c3a2/0xf210a9075089fd15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.145534:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06600 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:0.0:1782217125.145537:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec35c3a2/0xf210a9075089fd15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.145545:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec35c3a2/0xf210a9075089fd15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.145555:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec35c3a2/0xf210a9075089fd15 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.145569:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec35c3a2/0xf210a9075089fd15 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.145583:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782217125.145587:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069c90b12/0xf210a9075089fd1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.145594:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06200 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:0.0:1782217125.145597:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069c90b12/0xf210a9075089fd1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.145605:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069c90b12/0xf210a9075089fd1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.145616:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069c90b12/0xf210a9075089fd1c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.145623:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069c90b12/0xf210a9075089fd1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.145636:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782217125.145640:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f375ea8b/0xf210a9075089fd23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.145647:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06e00 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:0.0:1782217125.145656:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f375ea8b/0xf210a9075089fd23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.145663:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f375ea8b/0xf210a9075089fd23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.145674:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f375ea8b/0xf210a9075089fd23 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.145681:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f375ea8b/0xf210a9075089fd23 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.145694:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782217125.145697:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c591218c/0xf210a9075089fd2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.145703:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd07400 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:0.0:1782217125.145707:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c591218c/0xf210a9075089fd2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.145714:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c591218c/0xf210a9075089fd2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.145723:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c591218c/0xf210a9075089fd2a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.145731:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c591218c/0xf210a9075089fd2a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217125.145751:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217125.145752:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217125.145754:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217125.147611:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782217125.148747:0:15336:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217125.148767:0:15336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8363da8/0xf210a9075089fd31 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.148842:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1782217125.148848:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217125.148856:0:15336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8363da8/0xf210a9075089fd31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.148902:0:15336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8363da8/0xf210a9075089fd31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.148914:0:15336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8363da8/0xf210a9075089fd31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.148928:0:15336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8363da8/0xf210a9075089fd31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.148949:0:15336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1782217125.149482:0:15336:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217125.149489:0:15336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c027dcb/0xf210a9075089fd38 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.149498:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1782217125.149513:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217125.149518:0:15336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c027dcb/0xf210a9075089fd38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.149528:0:15336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c027dcb/0xf210a9075089fd38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.149550:0:15336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c027dcb/0xf210a9075089fd38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.149557:0:15336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c027dcb/0xf210a9075089fd38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.149571:0:15336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1782217125.150015:0:15336:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217125.150022:0:15336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f014dc96/0xf210a9075089fd3f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.150032:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1782217125.150035:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217125.150039:0:15336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f014dc96/0xf210a9075089fd3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.150049:0:15336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f014dc96/0xf210a9075089fd3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.150058:0:15336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f014dc96/0xf210a9075089fd3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.150065:0:15336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f014dc96/0xf210a9075089fd3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.150086:0:15336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1782217125.150483:0:15336:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217125.150489:0:15336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000143b5cb4/0xf210a9075089fd46 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.150497:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1782217125.150500:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217125.150516:0:15336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000143b5cb4/0xf210a9075089fd46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.150526:0:15336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000143b5cb4/0xf210a9075089fd46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.150535:0:15336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000143b5cb4/0xf210a9075089fd46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.150542:0:15336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000143b5cb4/0xf210a9075089fd46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.150551:0:15336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1782217125.150979:0:15336:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217125.150986:0:15336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013e1d531/0xf210a9075089fd4d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.150995:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1782217125.151004:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217125.151008:0:15336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013e1d531/0xf210a9075089fd4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.151018:0:15336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013e1d531/0xf210a9075089fd4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.151026:0:15336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013e1d531/0xf210a9075089fd4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.151034:0:15336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013e1d531/0xf210a9075089fd4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.151042:0:15336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1782217125.151453:0:15336:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217125.151460:0:15336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035b18c2b/0xf210a9075089fd54 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.151468:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1782217125.151472:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217125.151476:0:15336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035b18c2b/0xf210a9075089fd54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.151485:0:15336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035b18c2b/0xf210a9075089fd54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.151494:0:15336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035b18c2b/0xf210a9075089fd54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.152184:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1782217125.152195:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8363da8/0xf210a9075089fd31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.152206:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06400 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217125.152212:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8363da8/0xf210a9075089fd31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.152223:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8363da8/0xf210a9075089fd31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.152250:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8363da8/0xf210a9075089fd31 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.152258:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8363da8/0xf210a9075089fd31 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.152281:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1782217125.152284:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c027dcb/0xf210a9075089fd38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.152304:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640030c00 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217125.152308:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c027dcb/0xf210a9075089fd38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.152316:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c027dcb/0xf210a9075089fd38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.152325:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c027dcb/0xf210a9075089fd38 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.152332:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c027dcb/0xf210a9075089fd38 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.152345:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1782217125.152349:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f014dc96/0xf210a9075089fd3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.152356:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640031200 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217125.152359:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f014dc96/0xf210a9075089fd3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.152366:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f014dc96/0xf210a9075089fd3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.152374:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f014dc96/0xf210a9075089fd3f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.152386:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f014dc96/0xf210a9075089fd3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.152400:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782217125.152404:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000143b5cb4/0xf210a9075089fd46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.152411:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640031400 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217125.152414:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000143b5cb4/0xf210a9075089fd46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.152423:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000143b5cb4/0xf210a9075089fd46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.152434:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000143b5cb4/0xf210a9075089fd46 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.152441:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000143b5cb4/0xf210a9075089fd46 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.152455:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217125.152458:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013e1d531/0xf210a9075089fd4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.152465:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640030a00 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217125.152473:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013e1d531/0xf210a9075089fd4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.152481:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013e1d531/0xf210a9075089fd4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.152492:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013e1d531/0xf210a9075089fd4d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.152498:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013e1d531/0xf210a9075089fd4d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.152523:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217125.152524:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217125.152526:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217125.152558:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782217125.157277:0:5805:0:(osp_sync.c:1827:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:1.0:1782217125.157589:0:15336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035b18c2b/0xf210a9075089fd54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.157623:0:15336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782217125.158000:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217125.158009:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035b18c2b/0xf210a9075089fd54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.158019:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640030400 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217125.158025:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035b18c2b/0xf210a9075089fd54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.158038:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035b18c2b/0xf210a9075089fd54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.158066:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035b18c2b/0xf210a9075089fd54 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.158083:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035b18c2b/0xf210a9075089fd54 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.158107:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217125.158109:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217125.158111:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782217125.158674:0:15336:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217125.158683:0:15336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fc7bff0/0xf210a9075089fd5b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.158698:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1782217125.158703:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217125.158710:0:15336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fc7bff0/0xf210a9075089fd5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.158723:0:15336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fc7bff0/0xf210a9075089fd5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.158734:0:15336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fc7bff0/0xf210a9075089fd5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.158742:0:15336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fc7bff0/0xf210a9075089fd5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.159417:0:15336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1782217125.160016:0:15336:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217125.160028:0:15336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6e0616f/0xf210a9075089fd62 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.160050:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1782217125.160055:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217125.160061:0:15336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6e0616f/0xf210a9075089fd62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.160077:0:15336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6e0616f/0xf210a9075089fd62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.160088:0:15336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6e0616f/0xf210a9075089fd62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.160096:0:15336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6e0616f/0xf210a9075089fd62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.162986:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782217125.163005:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fc7bff0/0xf210a9075089fd5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.163023:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640031600 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217125.163029:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fc7bff0/0xf210a9075089fd5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.163042:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fc7bff0/0xf210a9075089fd5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.163069:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fc7bff0/0xf210a9075089fd5b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.163077:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fc7bff0/0xf210a9075089fd5b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.163109:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217125.163113:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6e0616f/0xf210a9075089fd62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.163129:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640030200 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217125.163132:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6e0616f/0xf210a9075089fd62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.163141:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6e0616f/0xf210a9075089fd62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.163152:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6e0616f/0xf210a9075089fd62 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.163160:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217125.163162:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217125.163164:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217125.164201:0:15336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1782217125.164216:0:15336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6e0616f/0xf210a9075089fd62 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.165021:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782217125.165920:0:15336:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217125.165934:0:15336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000231c32fa/0xf210a9075089fd69 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.165952:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1782217125.165958:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217125.165966:0:15336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000231c32fa/0xf210a9075089fd69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.165995:0:15336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000231c32fa/0xf210a9075089fd69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.166071:0:15336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000231c32fa/0xf210a9075089fd69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.166080:0:15336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000231c32fa/0xf210a9075089fd69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.166169:0:15336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782217125.166515:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217125.166524:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000231c32fa/0xf210a9075089fd69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.166534:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640030600 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217125.166541:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000231c32fa/0xf210a9075089fd69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.166552:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000231c32fa/0xf210a9075089fd69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.166573:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000231c32fa/0xf210a9075089fd69 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.166587:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000231c32fa/0xf210a9075089fd69 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.166611:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217125.166613:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217125.166615:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782217125.167076:0:15336:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217125.167085:0:15336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef6b345a/0xf210a9075089fd70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.167097:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1782217125.167100:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217125.167173:0:15336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef6b345a/0xf210a9075089fd70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.167187:0:15336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef6b345a/0xf210a9075089fd70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.167196:0:15336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef6b345a/0xf210a9075089fd70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.167216:0:15336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef6b345a/0xf210a9075089fd70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.167237:0:15336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782217125.167350:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217125.167358:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef6b345a/0xf210a9075089fd70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.167366:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e640031e00 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217125.167370:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef6b345a/0xf210a9075089fd70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.167380:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef6b345a/0xf210a9075089fd70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.167394:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef6b345a/0xf210a9075089fd70 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.167404:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef6b345a/0xf210a9075089fd70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.167421:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217125.167423:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217125.167424:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782217125.168217:0:15336:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217125.168228:0:15336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007acb2553/0xf210a9075089fd77 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.168241:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1782217125.168245:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217125.168251:0:15336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007acb2553/0xf210a9075089fd77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.168264:0:15336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007acb2553/0xf210a9075089fd77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.168275:0:15336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007acb2553/0xf210a9075089fd77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.168282:0:15336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007acb2553/0xf210a9075089fd77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.168306:0:15336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1782217125.169056:0:15336:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217125.169064:0:15336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006959b9c8/0xf210a9075089fd7e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.169082:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1782217125.169086:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217125.169091:0:15336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006959b9c8/0xf210a9075089fd7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.169102:0:15336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006959b9c8/0xf210a9075089fd7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.169121:0:15336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006959b9c8/0xf210a9075089fd7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.169129:0:15336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006959b9c8/0xf210a9075089fd7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.169151:0:15336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1782217125.169797:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782217125.169807:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007acb2553/0xf210a9075089fd77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.169818:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e675138200 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217125.169824:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007acb2553/0xf210a9075089fd77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.169834:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007acb2553/0xf210a9075089fd77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.169853:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007acb2553/0xf210a9075089fd77 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.169861:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007acb2553/0xf210a9075089fd77 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.169900:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217125.169903:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006959b9c8/0xf210a9075089fd7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.169910:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e675138a00 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217125.169979:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006959b9c8/0xf210a9075089fd7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.169988:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006959b9c8/0xf210a9075089fd7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.170013:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006959b9c8/0xf210a9075089fd7e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.170026:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006959b9c8/0xf210a9075089fd7e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.170042:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217125.170044:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217125.170046:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782217125.170355:0:15336:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217125.170364:0:15336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f77b88b/0xf210a9075089fd85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.170432:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1782217125.170437:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217125.170442:0:15336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f77b88b/0xf210a9075089fd85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.170455:0:15336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f77b88b/0xf210a9075089fd85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.170475:0:15336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f77b88b/0xf210a9075089fd85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.170483:0:15336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f77b88b/0xf210a9075089fd85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.170564:0:15336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782217125.170928:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217125.170935:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f77b88b/0xf210a9075089fd85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.170943:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e675138800 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217125.170947:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f77b88b/0xf210a9075089fd85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.170956:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f77b88b/0xf210a9075089fd85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.170969:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f77b88b/0xf210a9075089fd85 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.170975:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f77b88b/0xf210a9075089fd85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.171003:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217125.171005:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217125.171006:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217125.171117:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782217125.171346:0:15336:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217125.171352:0:15336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb1560a3/0xf210a9075089fd8c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.171361:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1782217125.171364:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217125.171369:0:15336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb1560a3/0xf210a9075089fd8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.171441:0:15336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb1560a3/0xf210a9075089fd8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.171450:0:15336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb1560a3/0xf210a9075089fd8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.171458:0:15336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb1560a3/0xf210a9075089fd8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.171546:0:15336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782217125.171837:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217125.171843:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb1560a3/0xf210a9075089fd8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.171852:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e675139800 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217125.171856:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb1560a3/0xf210a9075089fd8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.171864:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb1560a3/0xf210a9075089fd8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.171906:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb1560a3/0xf210a9075089fd8c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.171914:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb1560a3/0xf210a9075089fd8c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.171931:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217125.171932:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217125.171934:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782217125.172285:0:15336:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217125.172292:0:15336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096c80870/0xf210a9075089fd93 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.172302:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1782217125.172306:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217125.172312:0:15336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096c80870/0xf210a9075089fd93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.172322:0:15336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096c80870/0xf210a9075089fd93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.172330:0:15336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096c80870/0xf210a9075089fd93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.172338:0:15336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096c80870/0xf210a9075089fd93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.172362:0:15336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782217125.172543:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782217125.172549:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096c80870/0xf210a9075089fd93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217125.172558:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e675138000 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:2.0:1782217125.172562:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096c80870/0xf210a9075089fd93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217125.172570:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096c80870/0xf210a9075089fd93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217125.172587:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096c80870/0xf210a9075089fd93 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217125.172595:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096c80870/0xf210a9075089fd93 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217125.172612:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217125.172614:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217125.172616:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782217125.173343:0:15336:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217125.173353:0:15336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b613ce52/0xf210a9075089fd9a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.173366:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1782217125.173710:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217125.173717:0:15336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b613ce52/0xf210a9075089fd9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.173733:0:15336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b613ce52/0xf210a9075089fd9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.173743:0:15336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b613ce52/0xf210a9075089fd9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.173752:0:15336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b613ce52/0xf210a9075089fd9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.173985:0:15336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782217125.174019:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217125.174028:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b613ce52/0xf210a9075089fd9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.174052:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e675139c00 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217125.174057:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b613ce52/0xf210a9075089fd9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.174068:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b613ce52/0xf210a9075089fd9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.174086:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b613ce52/0xf210a9075089fd9a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.174093:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b613ce52/0xf210a9075089fd9a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.174116:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217125.174118:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217125.174120:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782217125.175997:0:15336:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217125.176084:0:15336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000263b986d/0xf210a9075089fda1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.176173:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1782217125.176181:0:15336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217125.176187:0:15336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000263b986d/0xf210a9075089fda1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.176205:0:15336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000263b986d/0xf210a9075089fda1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.176215:0:15336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000263b986d/0xf210a9075089fda1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.176230:0:15336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000263b986d/0xf210a9075089fda1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217125.176255:0:15336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1782217125.176749:0:15336:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:1.0:1782217125.176981:0:15336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f79c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14185:x1868789734013184:12345-0@lo:5:osp-pre-0-0.0 Request processed in 88105us (92711us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217125.176997:0:15336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782217125.177766:0:14185:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f79d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14185:1868789734013184:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1782217125.177787:0:14185:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:0.0:1782217125.177849:0:14185:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f79d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14185:1868789734013312:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1782217125.177930:0:14185:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217125.177988:0:14185:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e65255a540 going to sleep for 11 seconds 00010000:00010000:3.0:1782217125.178070:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217125.178081:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000263b986d/0xf210a9075089fda1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.178095:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e675139a00 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217125.178100:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000263b986d/0xf210a9075089fda1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.178112:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000263b986d/0xf210a9075089fda1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.178146:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000263b986d/0xf210a9075089fda1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.178155:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000263b986d/0xf210a9075089fda1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217125.178184:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217125.178187:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217125.178189:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782217125.178195:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734013312 00000100:00100000:1.0:1782217125.178204:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734013312 00000100:00100000:1.0:1782217125.178268:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782217125.178279:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f79fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14185:x1868789734013312:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1782217125.178335:0:14798:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:0.0:1782217125.190128:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f79fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14185:x1868789734013312:12345-0@lo:5:osp-pre-0-0.0 Request processed in 11830us (12177us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1782217125.190144:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782217125.191652:0:14185:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f79d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14185:1868789734013312:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1782217125.191676:0:14185:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1782217125.396078:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217126.420113:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217127.445137:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1782217127.698500:0:15469:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1782217127.698504:0:15469:0:(obd_mount.c:917:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1782217127.698611:0:15469:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff88e6751ec000 00000020:01000004:3.0:1782217127.698626:0:15469:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1782217127.698639:0:15469:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1782217127.698652:0:15469:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff88e67421b380) 00000020:00000080:3.0:1782217127.698671:0:15469:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1782217127.735305:0:15469:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1782217127.736315:0:15469:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1782217127.738492:0:15469:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1782217127.738743:0:15469:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1782217127.740402:0:15469:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1782217127.742303:0:15469:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 445: rc = 0 00100000:10000000:0.0:1782217127.742427:0:15469:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 445: rc = 0 00100000:10000000:0.0:1782217127.742530:0:15469:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 445: rc = 0 00100000:10000000:0.0:1782217127.746478:0:15469:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 342: rc = 0 00100000:10000000:1.0:1782217127.756504:0:15469:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 342: rc = 0 00100000:10000000:1.0:1782217127.756813:0:15469:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 342: rc = 0 00100000:10000000:1.0:1782217127.757309:0:15469:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 342: rc = 0 00100000:10000000:1.0:1782217127.757568:0:15469:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 342: rc = 0 00100000:10000000:1.0:1782217127.757964:0:15469:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 342: rc = 0 00000020:00000080:1.0:1782217127.758689:0:15469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1782217127.759957:0:15469:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1782217127.763010:0:15469:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf210a9075089fdaf 00000020:01000004:2.0:1782217127.763028:0:15469:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1782217127.763060:0:15469:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.119@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1782217127.763064:0:15469:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.119@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1782217127.763247:0:15469:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1782217127.763297:0:15469:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1782217127.763301:0:15469:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.119@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1782217127.794001:0:15469:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.119@tcp ctxt 0 is initialized 00000020:01000004:3.0:1782217127.794040:0:15469:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.119@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1782217127.794046:0:15469:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1782217127.794048:0:15469:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782217127.794049:0:15469:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782217127.794050:0:15469:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782217127.794051:0:15469:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782217127.794052:0:15469:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782217127.794053:0:15469:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782217127.794055:0:15469:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782217127.794056:0:15469:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782217127.794060:0:15469:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1782217127.794066:0:15469:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782217127.794067:0:15469:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782217127.794068:0:15469:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782217127.794069:0:15469:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782217127.794070:0:15469:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782217127.794070:0:15469:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782217127.796224:0:15469:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782217127.796233:0:15469:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782217127.796234:0:15469:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782217127.796281:0:15469:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1782217127.796303:0:15469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67420e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:15469:1868789734013440:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1782217127.796375:0:15469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217127.796432:0:15469:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e65255a900 going to sleep for 11 seconds 00000100:00100000:2.0:1782217127.796787:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734013440 00000100:00100000:2.0:1782217127.796795:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734013440 00000100:00100000:2.0:1782217127.796845:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1782217127.796853:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6446d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+16:15469:x1868789734013440:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1782217127.796919:0:14156:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1782217127.796922:0:14156:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1782217127.796926:0:14156:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1782217127.808626:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6446d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+16:15469:x1868789734013440:12345-0@lo:253:mount.lustre.0 Request processed in 11764us (12241us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217127.808907:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782217127.811864:0:15469:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67420e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:15469:1868789734013440:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1782217127.811910:0:15469:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1782217127.811928:0:15469:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782217127.811930:0:15469:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1782217127.811931:0:15469:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782217127.811932:0:15469:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782217127.811934:0:15469:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782217127.811935:0:15469:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782217127.811937:0:15469:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782217127.811938:0:15469:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782217127.811940:0:15469:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1782217127.812179:0:15469:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88e6751ec000 from lustre-OST0001 10000000:01000000:3.0:1782217127.812206:0:15469:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1782217127.812208:0:15469:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1782217127.812216:0:15469:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff88e67a633380 local copy 00010000:00010000:3.0:1782217127.812227:0:15469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67fd06c00/0xf210a9075089fb55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fb5c expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217127.812444:0:15469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67420e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:15469:1868789734013568:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782217127.812511:0:15469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217127.812551:0:15469:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e65255a240 going to sleep for 11 seconds 00000100:00100000:0.0:1782217127.812614:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734013568 00000100:00100000:0.0:1782217127.812622:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734013568 00000100:00100000:0.0:1782217127.812674:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1782217127.812683:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6446d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+16:15469:x1868789734013568:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782217127.813012:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6446d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+16:15469:x1868789734013568:12345-0@lo:501:mount.lustre.0 Request processed in 328us (499us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782217127.813020:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1782217127.813215:0:15469:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67420e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:15469:1868789734013568:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1782217127.813230:0:15469:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.119@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1782217127.813377:0:15469:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.119@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1782217127.813385:0:15469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67fd06c00/0xf210a9075089fb55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fb5c expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217127.813400:0:15469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e67fd06c00/0xf210a9075089fb55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fb5c expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782217127.813424:0:15469:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88e6751ec000 10000000:01000000:3.0:1782217127.813428:0:15469:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1782217127.813432:0:15469:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1782217127.813435:0:15469:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782217127.813439:0:15469:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1782217127.813443:0:15469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1782217127.813466:0:15469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e682171e00/0xf210a9075089fdb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217127.813473:0:15469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e682171e00/0xf210a9075089fdb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217127.813481:0:15469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e682171e00/0xf210a9075089fdb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217127.813504:0:15469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67420e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:15469:1868789734013696:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782217127.813533:0:15469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217127.813562:0:15469:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e65255a240 going to sleep for 11 seconds 00000100:00100000:2.0:1782217127.813626:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734013696 00000100:00100000:2.0:1782217127.813631:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734013696 00000100:00100000:2.0:1782217127.813669:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782217127.813677:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6446d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+16:15469:x1868789734013696:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782217127.813690:0:14155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217127.813711:0:14155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e6738af200/0xf210a9075089fdbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089fdb6 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217127.813732:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e6738af200/0xf210a9075089fdbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089fdb6 expref: 17 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217127.813741:0:14155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e6738af200/0xf210a9075089fdbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089fdb6 expref: 17 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217127.813749:0:14155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738af200, rc 0) 00000100:00100000:2.0:1782217127.813916:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6446d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+17:15469:x1868789734013696:12345-0@lo:101:mount.lustre.0 Request processed in 239us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217127.813924:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1782217127.814009:0:15469:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67420e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:15469:1868789734013696:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782217127.814022:0:15469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e682171e00/0xf210a9075089fdb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fdbd expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217127.814031:0:15469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e682171e00/0xf210a9075089fdb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089fdbd expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782217127.814913:0:15469:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1782217127.816657:0:15469:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782217127.818419:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1782217127.818469:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1782217127.818865:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1782217127.818960:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1782217127.819370:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1782217127.819411:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1782217127.819493:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1782217127.819502:0:15469:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1782217127.819602:0:15469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664486d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:15469:1868789734013824:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782217127.819669:0:15469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217127.819928:0:15469:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64e0d33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782217127.821246:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734013824 00000100:00100000:2.0:1782217127.821258:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734013824 00000100:00100000:2.0:1782217127.821362:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782217127.821371:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6446d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+17:15469:x1868789734013824:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782217127.821933:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6446d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+17:15469:x1868789734013824:12345-0@lo:501:mount.lustre.0 Request processed in 561us (2261us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217127.821942:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1782217127.822046:0:15469:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664486d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:15469:1868789734013824:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782217127.822107:0:15469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664486d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:15469:1868789734013952:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782217127.822160:0:15469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217127.826001:0:15469:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64e0d33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782217127.827336:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734013952 00000100:00100000:3.0:1782217127.827349:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734013952 00000100:00100000:3.0:1782217127.827407:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1782217127.827417:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6446d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+17:15469:x1868789734013952:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782217127.828116:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6446d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+17:15469:x1868789734013952:12345-0@lo:503:mount.lustre.0 Request processed in 697us (5953us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217127.828125:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1782217127.828736:0:15469:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664486d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:15469:1868789734013952:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1782217127.832967:0:15469:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782217127.833242:0:15469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67420c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:15469:1868789734014080:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782217127.833309:0:15469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217127.833393:0:15469:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e65255acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782217127.837755:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734014080 00000100:00100000:0.0:1782217127.837769:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734014080 00000100:00100000:0.0:1782217127.837970:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1782217127.837987:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6446d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+17:15469:x1868789734014080:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782217127.839276:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6446d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+17:15469:x1868789734014080:12345-0@lo:502:mount.lustre.0 Request processed in 1290us (5959us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217127.839287:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1782217127.839413:0:15469:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67420c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:15469:1868789734014080:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782217127.839740:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1782217127.839808:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1782217127.839844:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1782217127.839915:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1782217127.839953:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1782217127.839999:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1782217127.840048:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1782217127.840956:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1782217127.841037:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1782217127.841179:0:15469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664486d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:15469:1868789734014208:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782217127.841244:0:15469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217127.841287:0:15469:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64e0d3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782217127.841605:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734014208 00000100:00100000:3.0:1782217127.841613:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734014208 00000100:00100000:3.0:1782217127.841666:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782217127.841675:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e644dea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+17:15469:x1868789734014208:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782217127.842021:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e644dea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+17:15469:x1868789734014208:12345-0@lo:502:mount.lustre.0 Request processed in 346us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217127.842029:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1782217127.842094:0:15469:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664486d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:15469:1868789734014208:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1782217127.842169:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1782217127.842181:0:15469:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1782217127.846620:0:15470:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1782217127.846631:0:15470:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1782217127.846638:0:15470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782217127.846640:0:15470:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1782217127.846646:0:15470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782217127.846679:0:15470:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff88e541ef4d40) 00000020:00000080:3.0:1782217127.847070:0:15470:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1782217127.847171:0:15470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1782217127.847227:0:15470:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88e6751ec000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1782217127.847234:0:15470:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1782217127.847241:0:15470:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf210a9075089fdcb 00010000:00010000:3.0:1782217127.857184:0:15470:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1782217127.857595:0:15470:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1782217127.862725:0:15470:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1782217127.864648:0:15470:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1782217127.864659:0:15470:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782217127.864665:0:15470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782217127.864667:0:15470:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1782217127.864671:0:15470:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782217127.864675:0:15470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782217127.864676:0:15470:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782217127.864679:0:15470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782217127.864681:0:15470:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1782217127.864683:0:15470:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782217127.864685:0:15470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782217127.864686:0:15470:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1782217127.864688:0:15470:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782217127.864702:0:15470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782217127.864709:0:15470:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1782217127.864714:0:15470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1782217127.864763:0:15470:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782217127.864766:0:15470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782217127.864767:0:15470:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1782217127.864770:0:15470:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1782217127.868409:0:15469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1782217127.868440:0:15469:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1782217127.868462:0:15469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e682171e00/0xf210a9075089fdb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fdbd expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217127.868496:0:15469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e682171e00/0xf210a9075089fdb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fdbd expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782217127.868505:0:15469:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff88e6751ec000 from 1 10000000:01000000:3.0:1782217127.868508:0:15469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782217127.868544:0:15469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e682170600/0xf210a9075089fdd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217127.868552:0:15469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e682170600/0xf210a9075089fdd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217127.868563:0:15469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e682170600/0xf210a9075089fdd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217127.868586:0:15469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67420d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:15469:1868789734014336:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782217127.868649:0:15469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217127.868682:0:15469:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e67a3f0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782217127.868705:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734014336 00000100:00100000:3.0:1782217127.868711:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734014336 00000100:00100000:3.0:1782217127.868747:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782217127.868755:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e679f98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+17:15469:x1868789734014336:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782217127.868767:0:14156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217127.869159:0:14156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e682170400/0xf210a9075089fdd9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089fdd2 expref: -99 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217127.869186:0:14156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e682170400/0xf210a9075089fdd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089fdd2 expref: 18 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217127.869209:0:14156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e682170400/0xf210a9075089fdd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089fdd2 expref: 18 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217127.869218:0:14156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e682170400, rc 0) 00000100:00100000:3.0:1782217127.869266:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e679f98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+18:15469:x1868789734014336:12345-0@lo:101:mount.lustre.0 Request processed in 511us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217127.869273:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1782217127.871549:0:15469:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67420d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:15469:1868789734014336:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782217127.871579:0:15469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e682170600/0xf210a9075089fdd2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fdd9 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217127.871593:0:15469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e682170600/0xf210a9075089fdd2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089fdd9 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782217127.872369:0:15469:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1782217127.874747:0:15469:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782217127.881686:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1782217127.881786:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1782217127.881896:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1782217127.881906:0:15469:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1782217127.882005:0:15469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664487800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:15469:1868789734014464:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782217127.882063:0:15469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217127.882841:0:15469:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64e0d3840 going to sleep for 11 seconds 00000100:00100000:0.0:1782217127.883670:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734014464 00000100:00100000:0.0:1782217127.883680:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734014464 00000100:00100000:0.0:1782217127.883747:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1782217127.883757:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e679f9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+18:15469:x1868789734014464:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782217127.884070:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e679f9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+18:15469:x1868789734014464:12345-0@lo:501:mount.lustre.0 Request processed in 314us (2006us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217127.884087:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1782217127.886828:0:15469:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664487800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:15469:1868789734014464:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782217127.886906:0:15469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:15469:1868789734014592:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782217127.886988:0:15469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217127.887017:0:15469:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e644764300 going to sleep for 11 seconds 00000100:00100000:1.0:1782217127.887228:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734014592 00000100:00100000:1.0:1782217127.887235:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734014592 00000100:00100000:1.0:1782217127.887288:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1782217127.887297:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67aaa6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+18:15469:x1868789734014592:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782217127.887473:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67aaa6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+18:15469:x1868789734014592:12345-0@lo:503:mount.lustre.0 Request processed in 177us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217127.887481:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1782217127.888184:0:15469:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:15469:1868789734014592:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1782217127.888689:0:15469:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782217127.889930:0:15469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:15469:1868789734014720:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782217127.890173:0:15469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217127.890241:0:15469:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e644764300 going to sleep for 11 seconds 00000100:00100000:1.0:1782217127.894167:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734014720 00000100:00100000:1.0:1782217127.894185:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734014720 00000100:00100000:1.0:1782217127.894348:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1782217127.894359:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67aaa4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+18:15469:x1868789734014720:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782217127.894646:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67aaa4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+18:15469:x1868789734014720:12345-0@lo:502:mount.lustre.0 Request processed in 287us (4473us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217127.894654:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1782217127.894752:0:15469:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:15469:1868789734014720:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782217127.895355:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1782217127.895413:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1782217127.895462:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1782217127.895516:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1782217127.895549:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1782217127.895592:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1782217127.895627:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1782217127.895659:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1782217127.895703:0:15469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67420d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:15469:1868789734014848:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782217127.895763:0:15469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217127.895868:0:15469:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e67a3f0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782217127.896009:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734014848 00000100:00100000:2.0:1782217127.896016:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734014848 00000100:00100000:2.0:1782217127.896052:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1782217127.896060:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67aaa5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+18:15469:x1868789734014848:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782217127.896242:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67aaa5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+18:15469:x1868789734014848:12345-0@lo:502:mount.lustre.0 Request processed in 182us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217127.896250:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1782217127.896468:0:15469:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67420d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:15469:1868789734014848:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782217127.896575:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1782217127.896585:0:15469:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1782217127.898233:0:15474:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782217127.898253:0:15474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782217127.898255:0:15474:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1782217127.898265:0:15474:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff88e6751ec000 00000020:00000080:2.0:1782217127.898267:0:15474:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1782217127.898275:0:15474:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782217127.898277:0:15474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782217127.898278:0:15474:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1782217127.898281:0:15474:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782217127.898283:0:15474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782217127.898285:0:15474:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1782217127.898288:0:15474:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff88e6751ec000 00000020:00000080:2.0:1782217127.898290:0:15474:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1782217127.898379:0:15474:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782217127.898384:0:15474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782217127.898385:0:15474:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1782217127.898388:0:15474:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782217127.898391:0:15474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782217127.898392:0:15474:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1782217127.898396:0:15474:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88e6751ec000 00000020:00000080:2.0:1782217127.898398:0:15474:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1782217127.899158:0:15474:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782217127.899165:0:15474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782217127.899166:0:15474:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1782217127.899171:0:15474:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1782217127.902660:0:15469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1782217127.902753:0:15469:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782217127.902873:0:15469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e682170600/0xf210a9075089fdd2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fdd9 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217127.902913:0:15469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e682170600/0xf210a9075089fdd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fdd9 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782217127.902964:0:15469:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1782217127.902967:0:15469:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88e6751ec000 10000000:01000000:3.0:1782217127.902971:0:15469:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88e6751ec000 10000000:01000000:3.0:1782217127.902975:0:15469:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782217127.902981:0:15469:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff88e6751ec000 from 1 10000000:01000000:3.0:1782217127.903339:0:15469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782217127.903378:0:15469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e682171000/0xf210a9075089fde0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217127.903387:0:15469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e682171000/0xf210a9075089fde0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217127.903398:0:15469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e682171000/0xf210a9075089fde0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217127.903422:0:15469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67420d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:15469:1868789734014976:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782217127.903499:0:15469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217127.914320:0:15469:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e67a0e4240 going to sleep for 11 seconds 00000100:00100000:2.0:1782217127.915419:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734014976 00000100:00100000:2.0:1782217127.915430:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734014976 00000100:00100000:2.0:1782217127.915492:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1782217127.915504:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67aaa7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+18:15469:x1868789734014976:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782217127.915521:0:14157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217127.915539:0:14157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e6738afc00/0xf210a9075089fde7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089fde0 expref: -99 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217127.915566:0:14157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e6738afc00/0xf210a9075089fde7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089fde0 expref: 19 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217127.915586:0:14157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e6738afc00/0xf210a9075089fde7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089fde0 expref: 19 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217127.915595:0:14157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738afc00, rc 0) 00000100:00100000:2.0:1782217127.919818:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67aaa7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+19:15469:x1868789734014976:12345-0@lo:101:mount.lustre.0 Request processed in 4307us (16310us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217127.919830:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782217127.920148:0:15469:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67420d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:15469:1868789734014976:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782217127.920172:0:15469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e682171000/0xf210a9075089fde0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fde7 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217127.920185:0:15469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e682171000/0xf210a9075089fde0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089fde7 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782217127.920867:0:15469:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1782217127.921949:0:15469:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782217127.926273:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1782217127.926332:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1782217127.926381:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1782217127.926430:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1782217127.926468:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1782217127.926549:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1782217127.926583:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1782217127.926609:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1782217127.926648:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1782217127.926684:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1782217127.926716:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1782217127.926764:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1782217127.926800:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1782217127.926834:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1782217127.926912:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1782217127.926948:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1782217127.927254:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1782217127.927311:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1782217127.927342:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1782217127.927370:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1782217127.927411:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1782217127.927459:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1782217127.927512:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1782217127.927557:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1782217127.927590:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1782217127.927621:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1782217127.927663:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1782217127.927695:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1782217127.927729:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1782217127.927777:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1782217127.927814:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1782217127.927846:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1782217127.928155:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1782217127.928212:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1782217127.928245:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1782217127.928286:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1782217127.928315:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1782217127.928415:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1782217127.928423:0:15469:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1782217127.928654:0:15469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:15469:1868789734015104:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782217127.928717:0:15469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217127.928767:0:15469:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6516b7900 going to sleep for 11 seconds 00000100:00100000:1.0:1782217127.928857:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734015104 00000100:00100000:1.0:1782217127.928865:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734015104 00000100:00100000:1.0:1782217127.928937:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1782217127.928946:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67aaa5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+19:15469:x1868789734015104:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782217127.929352:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67aaa5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+19:15469:x1868789734015104:12345-0@lo:501:mount.lustre.0 Request processed in 406us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217127.929361:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1782217127.931163:0:15469:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:15469:1868789734015104:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782217127.931214:0:15469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:15469:1868789734015232:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782217127.931273:0:15469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217127.932303:0:15469:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6516b7900 going to sleep for 11 seconds 00000100:00100000:3.0:1782217127.937270:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734015232 00000100:00100000:3.0:1782217127.937282:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734015232 00000100:00100000:3.0:1782217127.938009:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1782217127.938021:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67aaa5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+19:15469:x1868789734015232:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782217127.938344:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67aaa5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+19:15469:x1868789734015232:12345-0@lo:503:mount.lustre.0 Request processed in 325us (7069us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217127.938351:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1782217127.938754:0:15469:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:15469:1868789734015232:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1782217127.939495:0:15469:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782217127.939569:0:15469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:15469:1868789734015360:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782217127.939627:0:15469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217127.940363:0:15469:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e646872540 going to sleep for 11 seconds 00000100:00100000:0.0:1782217127.940395:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734015360 00000100:00100000:0.0:1782217127.940403:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734015360 00000100:00100000:0.0:1782217127.940439:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1782217127.940447:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67aaa7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+19:15469:x1868789734015360:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782217127.940697:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67aaa7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+19:15469:x1868789734015360:12345-0@lo:502:mount.lustre.0 Request processed in 250us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217127.940705:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1782217127.941043:0:15469:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:15469:1868789734015360:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1782217127.941334:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1782217127.941384:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1782217127.941419:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1782217127.941466:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1782217127.941515:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1782217127.941566:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1782217127.941601:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1782217127.941632:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1782217127.941680:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1782217127.941715:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1782217127.941750:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1782217127.941869:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1782217127.942199:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1782217127.942235:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1782217127.942286:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1782217127.942322:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1782217127.942356:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1782217127.942406:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1782217127.942442:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1782217127.942476:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1782217127.942540:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1782217127.942577:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1782217127.942608:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1782217127.942653:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1782217127.942690:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1782217127.942725:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1782217127.942842:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1782217127.942947:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1782217127.943058:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1782217127.943235:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1782217127.943282:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1782217127.943336:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1782217127.943371:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1782217127.943420:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1782217127.943457:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1782217127.943514:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1782217127.943546:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1782217127.943574:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1782217127.943613:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1782217127.943646:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1782217127.943689:0:15469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:15469:1868789734015488:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782217127.943763:0:15469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217127.943930:0:15469:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6516b7900 going to sleep for 11 seconds 00000100:00100000:0.0:1782217127.944293:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734015488 00000100:00100000:0.0:1782217127.944301:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734015488 00000100:00100000:0.0:1782217127.944386:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1782217127.944395:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67aaa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+19:15469:x1868789734015488:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782217127.944621:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67aaa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+19:15469:x1868789734015488:12345-0@lo:502:mount.lustre.0 Request processed in 227us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217127.944629:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1782217127.944706:0:15469:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:15469:1868789734015488:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1782217127.944795:0:15469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1782217127.944805:0:15469:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1782217127.946327:0:15479:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1782217127.946341:0:15479:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff88e674080000) 00000020:00000080:2.0:1782217127.946362:0:15479:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1782217127.946527:0:15479:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88e6751ec000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1782217127.946531:0:15479:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88e6751ec000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1782217127.946534:0:15479:0:(obd_mount.c:701:lustre_put_lsi()) put ffff88e6751ec000 3 00010000:00080000:2.0:1782217127.946563:0:15479:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88e6755cb800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.119@tcp at head 00010000:00010000:2.0:1782217127.949687:0:15479:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1782217127.951032:0:15479:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1782217127.951149:0:15479:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1782217127.951162:0:15479:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf210a9075089fdf5 00000100:00080000:2.0:1782217127.951172:0:15479:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782217127.951179:0:15479:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88e6755cb800 using connection 192.168.203.119@tcp/0@lo 00000100:00100000:2.0:1782217127.951211:0:15479:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88e64e2a2680 x1868789734015616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782217127.951250:0:15479:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1782217127.951425:0:3300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3300:1868789734015616:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1782217127.951503:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217127.951659:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:713996b4-9a75-4cc4-875d-de8926ad5952:3303:1868789734015744:0@lo:400:kworker.0 00000100:00100000:3.0:1782217127.951690:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217127.951719:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734015744 00000100:00100000:3.0:1782217127.951725:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734015744 00000100:00100000:3.0:1782217127.951762:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1782217127.951770:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f2b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+19:3303:x1868789734015744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217127.951818:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f2b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+19:3303:x1868789734015744:12345-0@lo:400:kworker.0 Request processed in 48us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217127.951826:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1782217127.951862:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:713996b4-9a75-4cc4-875d-de8926ad5952:3303:1868789734015744:0@lo:400:kworker.0 00000100:00100000:2.0:1782217127.952079:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734015616 00000100:00100000:2.0:1782217127.952083:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734015616 00000100:00100000:2.0:1782217127.952114:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782217127.952120:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67420d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3300:x1868789734015616:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1782217127.952139:0:14162:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 447 last 0 00000020:00000080:2.0:1782217127.952178:0:14162:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf210a9075089fdfc 00000004:00100000:2.0:1782217127.952191:0:14162:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1782217127.952218:0:14162:0:(import.c:65:import_set_state_nolock()) ffff88e67f2d5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782217127.952257:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67420d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1868789734015616:12345-0@lo:38:llog_process_th.0 Request processed in 136us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217127.952263:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1782217127.952292:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88e64e2a2680 x1868789734015616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782217137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217127.952300:0:3300:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782217127.952306:0:3300:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1782217127.952311:0:3300:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1782217127.952315:0:3300:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1782217127.952317:0:3300:0:(import.c:65:import_set_state_nolock()) ffff88e6755cb800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1782217127.952322:0:3300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3300:1868789734015616:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1782217127.954263:0:15479:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:2.0:1782217127.954475:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:1.0:1782217127.955142:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782217127.955148:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1782217127.955151:0:38:0:(import.c:65:import_set_state_nolock()) ffff88e650a33000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782217127.955158:0:38:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 444 00000100:00080000:1.0:1782217127.955164:0:38:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1782217127.955170:0:38:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88e650a33000 using connection 192.168.203.119@tcp/0@lo 00000100:00100000:1.0:1782217127.955193:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88e664485500 x1868789734016000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782217127.955252:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1868789734016256:0@lo:400:kworker.0 00000100:00100000:1.0:1782217127.955314:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217127.955344:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782217127.955350:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1868789734016128:0@lo:400:kworker.0 00000100:00100000:1.0:1782217127.955383:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217127.955420:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734016256 00000100:00100000:1.0:1782217127.955427:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734016256 00000100:00100000:1.0:1782217127.955469:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734016128 00000100:00100000:1.0:1782217127.955472:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734016128 00000100:00100000:1.0:1782217127.955503:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782217127.955513:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1868789734016256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217127.955559:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1868789734016256:12345-0@lo:400:kworker.0 Request processed in 48us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217127.955565:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782217127.955580:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782217127.955587:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1868789734016128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217127.955613:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1868789734016128:12345-0@lo:400:kworker.0 Request processed in 27us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217127.955619:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1782217127.955635:0:14158:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782217127.955661:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88e664485180 x1868789734016128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782217127.955672:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1868789734016128:0@lo:400:kworker.0 00010000:00080000:1.0:1782217127.955681:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88e664486a00 x1868789734016256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782217127.955689:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1868789734016256:0@lo:400:kworker.0 00000020:01000000:3.0:1782217127.956684:0:15469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1782217127.956721:0:15469:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782217127.956745:0:15469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e682171000/0xf210a9075089fde0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fde7 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217127.956768:0:15469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e682171000/0xf210a9075089fde0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fde7 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1782217127.956830:0:15469:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1782217127.956832:0:15469:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782217127.956834:0:15469:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782217127.956835:0:15469:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782217127.956837:0:15469:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782217127.956838:0:15469:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782217127.956839:0:15469:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782217127.956841:0:15469:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782217127.956843:0:15469:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782217127.956847:0:15469:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1782217127.956849:0:15469:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782217127.956850:0:15469:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782217127.956852:0:15469:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782217127.956853:0:15469:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782217127.956854:0:15469:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782217127.956855:0:15469:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782217127.956856:0:15469:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782217127.956857:0:15469:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782217127.956858:0:15469:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782217127.956899:0:15469:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1782217127.956914:0:15469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67420d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:15469:1868789734016384:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1782217127.956969:0:15469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217127.957006:0:15469:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6525b9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782217127.957287:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734016384 00000100:00100000:0.0:1782217127.957294:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734016384 00000100:00100000:0.0:1782217127.957337:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1782217127.957346:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f2b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+19:15469:x1868789734016384:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1782217127.957368:0:14156:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1782217127.957381:0:14156:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1782217127.964407:0:3300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1868789734016000:0@lo:8:kworker.0 00000100:00100000:0.0:1782217127.964477:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217127.972845:0:14800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734016000 00000100:00100000:2.0:1782217127.972859:0:14800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734016000 00000100:00100000:2.0:1782217127.972917:0:14800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782217127.972933:0:14800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3300:x1868789734016000:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1782217127.973039:0:14800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3300:x1868789734016000:12345-0@lo:8:kworker.0 Request processed in 105us (8561us total) trans 0 rc -11/-11 00000100:00100000:2.0:1782217127.973046:0:14800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782217127.973253:0:3300:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782217127.973261:0:3300:0:(import.c:65:import_set_state_nolock()) ffff88e650a33000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782217127.973266:0:3300:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1782217127.973270:0:3300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1868789734016000:0@lo:8:kworker.0 00000100:00100000:2.0:1782217127.973312:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789734015872:0@lo:400:kworker.0 00000100:00100000:2.0:1782217127.973349:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217127.973376:0:14801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734015872 00000100:00100000:2.0:1782217127.973379:0:14801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734015872 00000100:00100000:2.0:1782217127.973416:0:14801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782217127.973422:0:14801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3303:x1868789734015872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217127.973459:0:14801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3303:x1868789734015872:12345-0@lo:400:kworker.0 Request processed in 38us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217127.973466:0:14801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1782217127.973481:0:14158:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782217127.973513:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789734015872:0@lo:400:kworker.0 20000000:01000000:0.0:1782217127.982256:0:14156:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1782217127.982277:0:14156:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1782217127.982354:0:14178:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1782217127.982360:0:14178:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1782217127.982381:0:14178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88e682171200/0xf210a9075089fe03 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217127.982411:0:14178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88e6738aea00/0xf210a9075089fcd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089fccf expref: 19 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217127.982436:0:14178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88e682171200/0xf210a9075089fe03 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217127.982472:0:14178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88e6738aea00/0xf210a9075089fcd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf210a9075089fccf expref: 19 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217127.982496:0:14178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88e6738aea00/0xf210a9075089fcd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf210a9075089fccf expref: 19 pid: 14155 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217127.982510:0:14178:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67420c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14178:1868789734016512:0@lo:104: 00000100:00100000:3.0:1782217127.982567:0:14178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217127.982610:0:14178:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64e380000 going to sleep for 11 seconds 00000100:00100000:1.0:1782217127.982782:0:14146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734016512 00000100:00100000:1.0:1782217127.982789:0:14146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734016512 00000100:00100000:1.0:1782217127.982836:0:14146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782217127.982844:0:14146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67420d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:713996b4-9a75-4cc4-875d-de8926ad5952+3:14178:x1868789734016512:12345-0@lo:104: 00010000:00010000:1.0:1782217127.982863:0:14146:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.119@tcp lock: ffff88e67437b600/0xf210a9075089fccf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089fcd6 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217127.982937:0:14146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782217127.982945:0:14146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67420d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:713996b4-9a75-4cc4-875d-de8926ad5952+3:14178:x1868789734016512:12345-0@lo:104: Request processed in 101us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217127.982952:0:14146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1782217127.983211:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217127.983218:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e67437b600/0xf210a9075089fccf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089fcd6 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217127.983225:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437b600 already unused, calling callback (ffffffffc1d2fc20) 10000000:00010000:3.0:1782217127.983229:0:14151:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e67437b600/0xf210a9075089fccf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf210a9075089fcd6 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217127.983239:0:14151:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e67437b600/0xf210a9075089fccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf210a9075089fcd6 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782217127.983247:0:14151:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e67437b600/0xf210a9075089fccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf210a9075089fcd6 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782217127.983253:0:14151:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1782217127.983288:0:14151:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: ffff88e67437b600/0xf210a9075089fccf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089fcd6 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217127.983305:0:14151:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782217127.983336:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e67437b600/0xf210a9075089fccf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089fcd6 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217127.983344:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e67437b600/0xf210a9075089fccf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089fcd6 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217127.983361:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217127.983362:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217127.983364:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217127.983372:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782217127.983481:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67420c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:713996b4-9a75-4cc4-875d-de8926ad5952:3304:1868789734016640:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782217127.983523:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217127.983573:0:14178:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67420c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14178:1868789734016512:0@lo:104: 00010000:00010000:3.0:1782217127.983591:0:14178:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88e682171200/0xf210a9075089fe03 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217127.984112:0:14150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734016640 00000100:00100000:0.0:1782217127.984119:0:14150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734016640 00010000:00010000:0.0:1782217127.984143:0:14150:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88e6738aea00/0xf210a9075089fcd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089fccf expref: 20 pid: 14155 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217127.984174:0:14150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782217127.984182:0:14150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67420e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:713996b4-9a75-4cc4-875d-de8926ad5952+20:3304:x1868789734016640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782217127.984194:0:14150:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217127.984199:0:14150:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88e6738aea00/0xf210a9075089fcd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089fccf expref: 20 pid: 14155 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217127.984209:0:14150:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88e6738aea00/0xf210a9075089fcd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf210a9075089fccf expref: 20 pid: 14155 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217127.984235:0:14150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e6738aea00/0xf210a9075089fcd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf210a9075089fccf expref: 20 pid: 14155 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217127.984248:0:14150:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88e682171200/0xf210a9075089fe03 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217127.984256:0:14150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e682171200/0xf210a9075089fe03 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782217127.984268:0:14150:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002678396s 00010000:00010000:0.0:1782217127.984273:0:14150:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88e682171200/0xf210a9075089fe03 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217127.984280:0:14150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88e682171200/0xf210a9075089fe03 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217127.984287:0:14150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88e682171200/0xf210a9075089fe03 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217127.984294:0:14150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88e682171200/0xf210a9075089fe03 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217127.984300:0:14150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e682171200 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:0.0:1782217127.984304:0:14150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88e682171200/0xf210a9075089fe03 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217127.984312:0:14150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88e682171200/0xf210a9075089fe03 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217127.984324:0:14150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88e682171200/0xf210a9075089fe03 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217127.984338:0:14150:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217127.984372:0:14150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67420e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:713996b4-9a75-4cc4-875d-de8926ad5952+19:3304:x1868789734016640:12345-0@lo:103:ldlm_bl.0 Request processed in 191us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217127.984380:0:14150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782217127.984558:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67420c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:713996b4-9a75-4cc4-875d-de8926ad5952:3304:1868789734016640:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782217127.984577:0:14178:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88e682171200/0xf210a9075089fe03 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217127.984584:0:14178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88e682171200/0xf210a9075089fe03 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217127.984591:0:14178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e682171200/0xf210a9075089fe03 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217128.002684:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f2b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+18:15469:x1868789734016384:12345-0@lo:253:mount.lustre.0 Request processed in 45331us (45706us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217128.002698:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1782217128.002865:0:15469:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67420d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:713996b4-9a75-4cc4-875d-de8926ad5952:15469:1868789734016384:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1782217128.002923:0:15469:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1782217128.002927:0:15469:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782217128.002929:0:15469:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782217128.002930:0:15469:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782217128.002932:0:15469:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782217128.002933:0:15469:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782217128.002934:0:15469:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782217128.002936:0:15469:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782217128.002937:0:15469:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782217128.002939:0:15469:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1782217128.002952:0:15469:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1782217128.011583:0:15469:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1782217128.011858:0:15469:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1782217128.012271:0:15469:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1782217128.012417:0:15469:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1782217128.012569:0:15469:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1782217128.013147:0:15469:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1782217128.014720:0:15469:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1782217128.069554:0:15469:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1782217128.069561:0:15469:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1782217128.069597:0:15469:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1782217128.069650:0:15469:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.119@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1782217128.069666:0:15469:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1782217128.069692:0:15469:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1782217128.476611:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782217129.439860:0:14160:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1782217129.439866:0:14160:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff88e652461000 from 8 10000000:01000000:1.0:1782217129.439871:0:14160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782217129.439955:0:14160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e675138e00/0xf210a9075089fe0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217129.439967:0:14160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e675138e00/0xf210a9075089fe0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217129.439977:0:14160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e675138e00/0xf210a9075089fe0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217129.440001:0:14160:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664486a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:713996b4-9a75-4cc4-875d-de8926ad5952:14160:1868789734016768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782217129.440064:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217129.440104:0:14160:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64e0d3000 going to sleep for 11 seconds 00000100:00100000:0.0:1782217129.440277:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734016768 00000100:00100000:0.0:1782217129.440286:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734016768 00000100:00100000:0.0:1782217129.440336:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1782217129.440344:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f2b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+18:14160:x1868789734016768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782217129.440357:0:14155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217129.440369:0:14155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e67437ae00/0xf210a9075089fe11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089fe0a expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217129.440390:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e67437ae00/0xf210a9075089fe11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089fe0a expref: 19 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217129.440399:0:14155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e67437ae00/0xf210a9075089fe11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089fe0a expref: 19 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217129.440408:0:14155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437ae00, rc 0) 00000100:00100000:0.0:1782217129.440442:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f2b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+19:14160:x1868789734016768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217129.440448:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1782217129.440512:0:14160:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664486a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:713996b4-9a75-4cc4-875d-de8926ad5952:14160:1868789734016768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782217129.440525:0:14160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e675138e00/0xf210a9075089fe0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fe11 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217129.440532:0:14160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e675138e00/0xf210a9075089fe0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089fe11 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217129.440577:0:14160:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f79df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:713996b4-9a75-4cc4-875d-de8926ad5952:14160:1868789734016896:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1782217129.440603:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217129.440616:0:14160:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e67f6dea80 going to sleep for 11 seconds 00000100:00100000:0.0:1782217129.440627:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734016896 00000100:00100000:0.0:1782217129.440629:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734016896 00000100:00100000:0.0:1782217129.440646:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1782217129.440651:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f2b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+19:14160:x1868789734016896:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1782217129.440662:0:14156:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1782217129.440678:0:14156:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1782217129.440681:0:14156:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1782217129.440755:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f2b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+19:14160:x1868789734016896:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 103us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217129.440762:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1782217129.440789:0:14160:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f79df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:713996b4-9a75-4cc4-875d-de8926ad5952:14160:1868789734016896:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1782217129.440839:0:14160:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782217129.440847:0:14160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e675138e00/0xf210a9075089fe0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fe11 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217129.440854:0:14160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e675138e00/0xf210a9075089fe0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089fe11 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217129.493513:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782217129.494806:0:6609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1782217129.494864:0:6609:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1782217130.452134:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782217130.452157:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f79df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789734017024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782217130.452225:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217130.452389:0:14802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734017024 00000100:00100000:0.0:1782217130.452406:0:14802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734017024 00000100:00100000:0.0:1782217130.452597:0:14802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782217130.452608:0:14802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789734017024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782217130.452641:0:14802:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782217130.452689:0:14802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789734017024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217130.452695:0:14802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1782217130.454523:0:14158:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782217130.454574:0:3303:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1782217130.454603:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f79df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789734017024:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782217130.517524:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217131.542542:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217132.565209:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782217132.886607:0:14196:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1782217133.013767:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782217133.013776:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1782217133.013789:0:8:0:(import.c:65:import_set_state_nolock()) ffff88e650a33000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782217133.013805:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88e650a33000 using connection 192.168.203.119@tcp/0@lo 00000100:00100000:1.0:1782217133.013836:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88e664486d80 x1868789734017408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782217133.013970:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789734017280:0@lo:400:kworker.0 00000100:00100000:1.0:1782217133.014060:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217133.014130:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782217133.014137:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:713996b4-9a75-4cc4-875d-de8926ad5952:3302:1868789734017152:0@lo:400:kworker.0 00000100:00100000:1.0:1782217133.014170:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217133.014193:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1868789734017792:0@lo:400:kworker.0 00000100:00100000:1.0:1782217133.014224:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217133.014253:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1868789734017664:0@lo:400:kworker.0 00000100:00100000:1.0:1782217133.014278:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217133.014295:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782217133.014301:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868789734017536:0@lo:400:kworker.0 00000100:00100000:1.0:1782217133.014322:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217133.014354:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734017792 00000100:00100000:1.0:1782217133.014363:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734017792 00000100:00100000:1.0:1782217133.014422:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734017664 00000100:00100000:1.0:1782217133.014425:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734017664 00000100:00100000:1.0:1782217133.014439:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734017536 00000100:00100000:1.0:1782217133.014442:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734017536 00000100:00100000:1.0:1782217133.014470:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782217133.014480:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1868789734017792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217133.014748:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734017152 00000100:00100000:0.0:1782217133.014753:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734017152 00000100:00100000:0.0:1782217133.014790:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1782217133.014798:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f2b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+19:3302:x1868789734017152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217133.014845:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f2b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+19:3302:x1868789734017152:12345-0@lo:400:kworker.0 Request processed in 48us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217133.014852:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1782217133.014968:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1868789734017792:12345-0@lo:400:kworker.0 Request processed in 489us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217133.014975:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782217133.015001:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782217133.015007:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868789734017664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217133.015043:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868789734017664:12345-0@lo:400:kworker.0 Request processed in 36us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217133.015049:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782217133.015061:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782217133.015066:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868789734017536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217133.015093:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868789734017536:12345-0@lo:400:kworker.0 Request processed in 27us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217133.015100:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1782217133.015425:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e664485880 x1868789734017536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782217133.015442:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868789734017536:0@lo:400:kworker.0 00010000:00080000:1.0:1782217133.015464:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e664486680 x1868789734017664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782217133.015473:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1868789734017664:0@lo:400:kworker.0 00000100:00100000:2.0:1782217133.015640:0:3300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e664486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1868789734017408:0@lo:8:kworker.0 00000100:00100000:2.0:1782217133.015692:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217133.015737:0:14800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734017280 00000100:00100000:2.0:1782217133.015742:0:14800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734017280 00000100:00100000:2.0:1782217133.015778:0:14800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734017408 00000100:00100000:2.0:1782217133.015781:0:14800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734017408 00000100:00100000:2.0:1782217133.015804:0:14800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782217133.015812:0:14800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789734017280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217133.015850:0:14800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789734017280:12345-0@lo:400:kworker.0 Request processed in 39us (1791us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217133.015856:0:14800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782217133.015869:0:14800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782217133.015873:0:14800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3300:x1868789734017408:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1782217133.015947:0:14800:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:2.0:1782217133.015982:0:14800:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf210a9075089fe18 00002000:00100000:2.0:1782217133.016000:0:14800:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff88e67f2aa800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1782217133.016005:0:14800:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1782217133.016008:0:14800:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1782217133.016381:0:14800:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1782217133.016410:0:14800:0:(import.c:65:import_set_state_nolock()) ffff88e67f2ac000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782217133.016469:0:14800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3300:x1868789734017408:12345-0@lo:8:kworker.0 Request processed in 593us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217133.016478:0:14800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1782217133.016501:0:14158:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782217133.016506:0:14158:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782217133.016748:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e664486d80 x1868789734017408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782217158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1782217133.016766:0:3300:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1782217133.016787:0:3300:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1782217133.016793:0:3300:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1782217133.016797:0:3300:0:(import.c:65:import_set_state_nolock()) ffff88e650a33000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1782217133.016822:0:3300:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1782217133.016828:0:3300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1868789734017408:0@lo:8:kworker.0 00000004:00080000:0.0:1782217133.018909:0:14187:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:0.0:1782217133.019058:0:14187:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f79ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14187:1868789734018048:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1782217133.019142:0:14187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217133.019178:0:14187:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e644764e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782217133.019216:0:14800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734018048 00000100:00100000:0.0:1782217133.019224:0:14800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734018048 00000100:00100000:0.0:1782217133.019290:0:14800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782217133.019305:0:14800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f79ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14187:x1868789734018048:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1782217133.019621:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782217133.019635:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f79f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789734017920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782217133.019673:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217133.019714:0:15335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734017920 00000100:00100000:2.0:1782217133.019718:0:15335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734017920 00000100:00100000:2.0:1782217133.019751:0:15335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782217133.019758:0:15335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1868789734017920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782217133.019788:0:15335:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782217133.019838:0:15335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1868789734017920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217133.019846:0:15335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1782217133.021037:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e67f79f800 x1868789734017920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782217149 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217133.021067:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f79f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789734017920:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1782217133.021280:0:14186:0:(osp_sync.c:1060:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1782217133.021861:0:14186:0:(osp_sync.c:1862:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 452073982452ns, next at 0ns, rc = 0 00000100:00080000:1.0:1782217133.028471:0:14158:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782217133.030224:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:713996b4-9a75-4cc4-875d-de8926ad5952:3302:1868789734017152:0@lo:400:kworker.0 00010000:00080000:1.0:1782217133.030266:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88e664484700 x1868789734017792/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782217133.030280:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1868789734017792:0@lo:400:kworker.0 00000100:00100000:1.0:1782217133.030295:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e664487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789734017280:0@lo:400:kworker.0 00002000:00080000:1.0:1782217133.032186:0:14800:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1782217133.032206:0:14800:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1782217133.032214:0:14800:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:1.0:1782217133.043796:0:14800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217133.043814:0:14800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a7e98f5/0xf210a9075089fe1f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.043838:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1782217133.043843:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217133.043851:0:14800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a7e98f5/0xf210a9075089fe1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.043872:0:14800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a7e98f5/0xf210a9075089fe1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.043932:0:14800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a7e98f5/0xf210a9075089fe1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.043941:0:14800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a7e98f5/0xf210a9075089fe1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.044238:0:14800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782217133.045126:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217133.045137:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a7e98f5/0xf210a9075089fe1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.045149:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e675138c00 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217133.045155:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a7e98f5/0xf210a9075089fe1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.045183:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a7e98f5/0xf210a9075089fe1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.045210:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a7e98f5/0xf210a9075089fe1f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.045219:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a7e98f5/0xf210a9075089fe1f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.045247:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217133.045249:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217133.045251:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782217133.052759:0:14800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217133.052776:0:14800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000879bcdb9/0xf210a9075089fe26 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.052799:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1782217133.052803:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217133.052810:0:14800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000879bcdb9/0xf210a9075089fe26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.052837:0:14800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000879bcdb9/0xf210a9075089fe26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.052849:0:14800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000879bcdb9/0xf210a9075089fe26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.052858:0:14800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000879bcdb9/0xf210a9075089fe26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.052915:0:14800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782217133.052932:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782217133.052939:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000879bcdb9/0xf210a9075089fe26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.052948:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e675138400 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:1.0:1782217133.052953:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000879bcdb9/0xf210a9075089fe26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.052963:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000879bcdb9/0xf210a9075089fe26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.052983:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000879bcdb9/0xf210a9075089fe26 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.052991:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000879bcdb9/0xf210a9075089fe26 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.053020:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217133.053022:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217133.053024:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782217133.053481:0:14800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217133.053487:0:14800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eeb0804b/0xf210a9075089fe2d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.053496:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1782217133.053500:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217133.053504:0:14800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eeb0804b/0xf210a9075089fe2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.053514:0:14800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eeb0804b/0xf210a9075089fe2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.053523:0:14800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eeb0804b/0xf210a9075089fe2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.053531:0:14800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eeb0804b/0xf210a9075089fe2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.053550:0:14800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782217133.053560:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782217133.053565:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eeb0804b/0xf210a9075089fe2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.053584:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e675139600 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:1.0:1782217133.053587:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eeb0804b/0xf210a9075089fe2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.053595:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eeb0804b/0xf210a9075089fe2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.053606:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eeb0804b/0xf210a9075089fe2d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.053613:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eeb0804b/0xf210a9075089fe2d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.053628:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217133.053629:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217133.053631:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782217133.054081:0:14800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217133.054087:0:14800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbbbc72d/0xf210a9075089fe34 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.054096:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1782217133.054099:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217133.054103:0:14800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbbbc72d/0xf210a9075089fe34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.054112:0:14800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbbbc72d/0xf210a9075089fe34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.054127:0:14800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbbbc72d/0xf210a9075089fe34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.054134:0:14800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cbbbc72d/0xf210a9075089fe34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.054149:0:14800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782217133.054157:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782217133.054161:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cbbbc72d/0xf210a9075089fe34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.054167:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e675138600 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:1.0:1782217133.054170:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbbbc72d/0xf210a9075089fe34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.054177:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbbbc72d/0xf210a9075089fe34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.054188:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cbbbc72d/0xf210a9075089fe34 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.054194:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbbbc72d/0xf210a9075089fe34 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.054209:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217133.054216:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217133.054218:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782217133.054671:0:14800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217133.054678:0:14800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e72e0b2/0xf210a9075089fe3b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.054687:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1782217133.054691:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217133.054695:0:14800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e72e0b2/0xf210a9075089fe3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.054704:0:14800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e72e0b2/0xf210a9075089fe3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.054714:0:14800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e72e0b2/0xf210a9075089fe3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.054720:0:14800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e72e0b2/0xf210a9075089fe3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.054737:0:14800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782217133.054748:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782217133.054753:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e72e0b2/0xf210a9075089fe3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.054759:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e675139000 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:1.0:1782217133.054762:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e72e0b2/0xf210a9075089fe3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.054782:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e72e0b2/0xf210a9075089fe3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.054793:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e72e0b2/0xf210a9075089fe3b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.054800:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e72e0b2/0xf210a9075089fe3b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.054814:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217133.054816:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217133.054817:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782217133.055228:0:14800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217133.055234:0:14800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096c80870/0xf210a9075089fe42 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.055243:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1782217133.055247:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217133.055251:0:14800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096c80870/0xf210a9075089fe42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.055259:0:14800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096c80870/0xf210a9075089fe42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.055268:0:14800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096c80870/0xf210a9075089fe42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.055281:0:14800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096c80870/0xf210a9075089fe42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.055296:0:14800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782217133.055305:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782217133.055309:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096c80870/0xf210a9075089fe42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.055316:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e675138000 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:1.0:1782217133.055319:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096c80870/0xf210a9075089fe42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.055328:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096c80870/0xf210a9075089fe42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.055340:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096c80870/0xf210a9075089fe42 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.055348:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096c80870/0xf210a9075089fe42 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.055362:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217133.055364:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217133.055366:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782217133.057477:0:14800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217133.057502:0:14800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000263b986d/0xf210a9075089fe49 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.057522:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1782217133.057527:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217133.057534:0:14800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000263b986d/0xf210a9075089fe49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.057551:0:14800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000263b986d/0xf210a9075089fe49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.057562:0:14800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000263b986d/0xf210a9075089fe49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.057572:0:14800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000263b986d/0xf210a9075089fe49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.057604:0:14800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782217133.058020:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217133.058029:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000263b986d/0xf210a9075089fe49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.058040:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e675139a00 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217133.058046:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000263b986d/0xf210a9075089fe49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.058058:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000263b986d/0xf210a9075089fe49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.058081:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000263b986d/0xf210a9075089fe49 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.058103:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000263b986d/0xf210a9075089fe49 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.058130:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217133.058132:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217133.058134:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782217133.058388:0:14800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217133.058394:0:14800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b613ce52/0xf210a9075089fe50 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.058403:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1782217133.058407:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217133.058411:0:14800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b613ce52/0xf210a9075089fe50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.058421:0:14800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b613ce52/0xf210a9075089fe50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.058434:0:14800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b613ce52/0xf210a9075089fe50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.058442:0:14800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b613ce52/0xf210a9075089fe50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.058510:0:14800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1782217133.059018:0:14800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217133.059025:0:14800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb1560a3/0xf210a9075089fe57 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.059035:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1782217133.059038:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217133.059042:0:14800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb1560a3/0xf210a9075089fe57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.059052:0:14800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb1560a3/0xf210a9075089fe57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.059061:0:14800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb1560a3/0xf210a9075089fe57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.059070:0:14800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb1560a3/0xf210a9075089fe57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.060887:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782217133.061028:0:14800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1782217133.061663:0:14800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217133.061675:0:14800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f77b88b/0xf210a9075089fe5e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.061696:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1782217133.061702:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217133.061708:0:14800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f77b88b/0xf210a9075089fe5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.061723:0:14800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f77b88b/0xf210a9075089fe5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.061735:0:14800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f77b88b/0xf210a9075089fe5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.061743:0:14800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f77b88b/0xf210a9075089fe5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.061755:0:14800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1782217133.062532:0:14800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217133.062541:0:14800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006959b9c8/0xf210a9075089fe65 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.062553:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1782217133.062564:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217133.062569:0:14800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006959b9c8/0xf210a9075089fe65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.062581:0:14800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006959b9c8/0xf210a9075089fe65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.062591:0:14800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006959b9c8/0xf210a9075089fe65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.062598:0:14800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006959b9c8/0xf210a9075089fe65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.062610:0:14800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1782217133.063077:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b613ce52/0xf210a9075089fe50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.063089:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e675139c00 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217133.063093:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b613ce52/0xf210a9075089fe50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.063103:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b613ce52/0xf210a9075089fe50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.063125:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b613ce52/0xf210a9075089fe50 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.063132:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b613ce52/0xf210a9075089fe50 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.063162:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1782217133.063167:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb1560a3/0xf210a9075089fe57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.063183:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e675139800 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217133.063186:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb1560a3/0xf210a9075089fe57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.063195:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb1560a3/0xf210a9075089fe57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.063206:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb1560a3/0xf210a9075089fe57 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.063213:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb1560a3/0xf210a9075089fe57 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.063226:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782217133.063230:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f77b88b/0xf210a9075089fe5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.063237:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e675138800 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217133.063240:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f77b88b/0xf210a9075089fe5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.063247:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f77b88b/0xf210a9075089fe5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.063255:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f77b88b/0xf210a9075089fe5e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.063267:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f77b88b/0xf210a9075089fe5e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.063281:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217133.063284:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006959b9c8/0xf210a9075089fe65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.063291:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e675138a00 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217133.063294:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006959b9c8/0xf210a9075089fe65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.063302:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006959b9c8/0xf210a9075089fe65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.063312:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006959b9c8/0xf210a9075089fe65 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.063320:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006959b9c8/0xf210a9075089fe65 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.063332:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217133.063334:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217133.063336:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217133.063350:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782217133.063628:0:14800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217133.063636:0:14800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007acb2553/0xf210a9075089fe6c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.063646:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1782217133.063650:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217133.063656:0:14800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007acb2553/0xf210a9075089fe6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.063667:0:14800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007acb2553/0xf210a9075089fe6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.063676:0:14800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007acb2553/0xf210a9075089fe6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.063689:0:14800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007acb2553/0xf210a9075089fe6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.063717:0:14800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782217133.064214:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217133.064221:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007acb2553/0xf210a9075089fe6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.064235:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e675138200 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217133.064239:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007acb2553/0xf210a9075089fe6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.064248:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007acb2553/0xf210a9075089fe6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.064261:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007acb2553/0xf210a9075089fe6c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.064269:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007acb2553/0xf210a9075089fe6c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.064289:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217133.064290:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217133.064292:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782217133.072253:0:14800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217133.072272:0:14800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b21bfca1/0xf210a9075089fe73 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.072294:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1782217133.072299:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217133.072306:0:14800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b21bfca1/0xf210a9075089fe73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.072323:0:14800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b21bfca1/0xf210a9075089fe73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.072336:0:14800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b21bfca1/0xf210a9075089fe73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.072343:0:14800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b21bfca1/0xf210a9075089fe73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.072368:0:14800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1782217133.072872:0:14800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782217133.073073:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217133.073083:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b21bfca1/0xf210a9075089fe73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.073094:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e675139e00 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217133.073100:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b21bfca1/0xf210a9075089fe73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.073112:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b21bfca1/0xf210a9075089fe73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.073142:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b21bfca1/0xf210a9075089fe73 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.073150:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b21bfca1/0xf210a9075089fe73 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.073176:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217133.073178:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217133.073180:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217133.073220:0:14800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1c58cff/0xf210a9075089fe7a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.073234:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1782217133.073237:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217133.073242:0:14800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1c58cff/0xf210a9075089fe7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.073253:0:14800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1c58cff/0xf210a9075089fe7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.073261:0:14800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1c58cff/0xf210a9075089fe7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.073269:0:14800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1c58cff/0xf210a9075089fe7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.073289:0:14800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1782217133.073759:0:14800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217133.073765:0:14800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e1d8b31/0xf210a9075089fe81 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.073774:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1782217133.073776:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217133.073780:0:14800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e1d8b31/0xf210a9075089fe81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.073790:0:14800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e1d8b31/0xf210a9075089fe81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.073809:0:14800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e1d8b31/0xf210a9075089fe81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.073817:0:14800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e1d8b31/0xf210a9075089fe81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.073830:0:14800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1782217133.074079:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782217133.074088:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1c58cff/0xf210a9075089fe7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.074097:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e675139200 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217133.074101:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1c58cff/0xf210a9075089fe7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.074111:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1c58cff/0xf210a9075089fe7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.074125:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1c58cff/0xf210a9075089fe7a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.074133:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1c58cff/0xf210a9075089fe7a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.074165:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217133.074169:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e1d8b31/0xf210a9075089fe81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.074176:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e675139400 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217133.074179:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e1d8b31/0xf210a9075089fe81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.074187:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e1d8b31/0xf210a9075089fe81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.074196:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e1d8b31/0xf210a9075089fe81 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.074202:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e1d8b31/0xf210a9075089fe81 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.074214:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217133.074215:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217133.074217:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217133.074226:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782217133.076582:0:14800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217133.076597:0:14800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ca49146/0xf210a9075089fe88 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.076617:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1782217133.076622:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217133.076629:0:14800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ca49146/0xf210a9075089fe88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.076643:0:14800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ca49146/0xf210a9075089fe88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.076654:0:14800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ca49146/0xf210a9075089fe88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.076662:0:14800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ca49146/0xf210a9075089fe88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.076698:0:14800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782217133.076717:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782217133.076724:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ca49146/0xf210a9075089fe88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.076733:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e5410b0e00 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:1.0:1782217133.076738:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ca49146/0xf210a9075089fe88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.076748:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ca49146/0xf210a9075089fe88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.076768:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ca49146/0xf210a9075089fe88 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.076776:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ca49146/0xf210a9075089fe88 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.076798:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217133.076800:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217133.076802:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782217133.082760:0:5805:0:(osp_sync.c:1827:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1782217133.089283:0:14800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217133.089300:0:14800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ca49146/0xf210a9075089fe8f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.089324:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1782217133.089336:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217133.089344:0:14800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ca49146/0xf210a9075089fe8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.089363:0:14800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ca49146/0xf210a9075089fe8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.089376:0:14800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ca49146/0xf210a9075089fe8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.089385:0:14800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ca49146/0xf210a9075089fe8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.089410:0:14800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782217133.090131:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217133.090142:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ca49146/0xf210a9075089fe8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.090167:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e5410b0e00 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217133.090173:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ca49146/0xf210a9075089fe8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.090185:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ca49146/0xf210a9075089fe8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.090208:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ca49146/0xf210a9075089fe8f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.090217:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ca49146/0xf210a9075089fe8f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.090240:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217133.090241:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217133.090243:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782217133.090426:0:14800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217133.090434:0:14800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029805a87/0xf210a9075089fe96 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.090454:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1782217133.090459:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217133.090465:0:14800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029805a87/0xf210a9075089fe96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.090476:0:14800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029805a87/0xf210a9075089fe96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.090485:0:14800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029805a87/0xf210a9075089fe96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.090500:0:14800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029805a87/0xf210a9075089fe96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.090620:0:14800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1782217133.091263:0:14800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217133.091272:0:14800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4113d44/0xf210a9075089fe9d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.091283:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1782217133.091287:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217133.091292:0:14800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4113d44/0xf210a9075089fe9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.091304:0:14800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4113d44/0xf210a9075089fe9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.091313:0:14800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4113d44/0xf210a9075089fe9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.091320:0:14800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4113d44/0xf210a9075089fe9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.091909:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782217133.091921:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029805a87/0xf210a9075089fe96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.091930:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e5410b1400 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217133.091936:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029805a87/0xf210a9075089fe96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.092054:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029805a87/0xf210a9075089fe96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.092083:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029805a87/0xf210a9075089fe96 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.092092:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029805a87/0xf210a9075089fe96 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.092113:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217133.092117:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4113d44/0xf210a9075089fe9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.092124:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e5410b0200 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217133.092128:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4113d44/0xf210a9075089fe9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.092136:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4113d44/0xf210a9075089fe9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.092147:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4113d44/0xf210a9075089fe9d lrc: 2/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.092156:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217133.092158:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217133.092161:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217133.092375:0:14800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1782217133.092383:0:14800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4113d44/0xf210a9075089fe9d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782217133.093296:0:14800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217133.093307:0:14800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006466a02c/0xf210a9075089fea4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.093321:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1782217133.093325:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217133.093331:0:14800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006466a02c/0xf210a9075089fea4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.093344:0:14800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006466a02c/0xf210a9075089fea4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.093355:0:14800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006466a02c/0xf210a9075089fea4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.093363:0:14800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006466a02c/0xf210a9075089fea4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.095267:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217133.095285:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006466a02c/0xf210a9075089fea4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.095315:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e5410b0a00 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217133.095321:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006466a02c/0xf210a9075089fea4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.095332:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006466a02c/0xf210a9075089fea4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.095357:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006466a02c/0xf210a9075089fea4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.095370:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217133.095372:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217133.095374:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217133.095474:0:14800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1782217133.095483:0:14800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006466a02c/0xf210a9075089fea4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782217133.096500:0:14800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217133.096511:0:14800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f69d46ee/0xf210a9075089feab lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.096595:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1782217133.096600:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217133.096608:0:14800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f69d46ee/0xf210a9075089feab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.096625:0:14800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f69d46ee/0xf210a9075089feab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.096635:0:14800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f69d46ee/0xf210a9075089feab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.096644:0:14800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f69d46ee/0xf210a9075089feab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.097108:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217133.097119:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f69d46ee/0xf210a9075089feab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.097131:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e5410b0800 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217133.097137:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f69d46ee/0xf210a9075089feab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.097149:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f69d46ee/0xf210a9075089feab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.097167:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f69d46ee/0xf210a9075089feab lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.097189:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217133.097190:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217133.097193:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217133.097274:0:14800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1782217133.097281:0:14800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f69d46ee/0xf210a9075089feab lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782217133.098084:0:14800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217133.098094:0:14800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c83518ad/0xf210a9075089feb2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.098106:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1782217133.098111:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217133.098116:0:14800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c83518ad/0xf210a9075089feb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.098141:0:14800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c83518ad/0xf210a9075089feb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.098152:0:14800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c83518ad/0xf210a9075089feb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.098161:0:14800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c83518ad/0xf210a9075089feb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.098298:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217133.098306:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c83518ad/0xf210a9075089feb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.098315:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e5410b1800 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217133.098319:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c83518ad/0xf210a9075089feb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.098327:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c83518ad/0xf210a9075089feb2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.098341:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c83518ad/0xf210a9075089feb2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.098351:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217133.098353:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217133.098355:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217133.098419:0:14800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1782217133.098425:0:14800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c83518ad/0xf210a9075089feb2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782217133.099170:0:14800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217133.099179:0:14800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006794496c/0xf210a9075089feb9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.099191:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1782217133.099196:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217133.099201:0:14800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006794496c/0xf210a9075089feb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.099213:0:14800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006794496c/0xf210a9075089feb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.099236:0:14800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006794496c/0xf210a9075089feb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.099245:0:14800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006794496c/0xf210a9075089feb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.099609:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217133.099617:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006794496c/0xf210a9075089feb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.099627:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e5410b0000 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217133.099632:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006794496c/0xf210a9075089feb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.099650:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006794496c/0xf210a9075089feb9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.099667:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006794496c/0xf210a9075089feb9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.099677:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217133.099679:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217133.099680:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217133.099754:0:14800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1782217133.099760:0:14800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006794496c/0xf210a9075089feb9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782217133.100616:0:14800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217133.100625:0:14800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081236393/0xf210a9075089fec0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.100640:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1782217133.100644:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217133.100650:0:14800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081236393/0xf210a9075089fec0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.100663:0:14800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081236393/0xf210a9075089fec0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.100672:0:14800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081236393/0xf210a9075089fec0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.100693:0:14800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081236393/0xf210a9075089fec0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.100834:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217133.100843:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081236393/0xf210a9075089fec0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.100852:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e5410b1c00 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217133.100857:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081236393/0xf210a9075089fec0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.100868:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081236393/0xf210a9075089fec0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.101144:0:14800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1782217133.101624:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081236393/0xf210a9075089fec0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217133.101634:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081236393/0xf210a9075089fec0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782217133.102095:0:14800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217133.102103:0:14800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b07dcc0/0xf210a9075089fec7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.102114:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1782217133.102118:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217133.102123:0:14800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b07dcc0/0xf210a9075089fec7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.102134:0:14800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b07dcc0/0xf210a9075089fec7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.102142:0:14800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b07dcc0/0xf210a9075089fec7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.102148:0:14800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b07dcc0/0xf210a9075089fec7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217133.102317:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782217133.102325:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b07dcc0/0xf210a9075089fec7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217133.102334:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e5410b1a00 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:2.0:1782217133.102340:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b07dcc0/0xf210a9075089fec7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217133.102362:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b07dcc0/0xf210a9075089fec7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217133.102378:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b07dcc0/0xf210a9075089fec7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217133.102387:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217133.102389:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217133.102391:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217133.102397:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217133.102398:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217133.102399:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217133.102465:0:14800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1782217133.102470:0:14800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b07dcc0/0xf210a9075089fec7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782217133.103352:0:14800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217133.103361:0:14800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004834de81/0xf210a9075089fece lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.103375:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1782217133.103379:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217133.103384:0:14800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004834de81/0xf210a9075089fece lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.103395:0:14800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004834de81/0xf210a9075089fece lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.103403:0:14800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004834de81/0xf210a9075089fece lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.103411:0:14800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004834de81/0xf210a9075089fece lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217133.103480:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782217133.103487:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004834de81/0xf210a9075089fece lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217133.103495:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e5410b1000 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:2.0:1782217133.103499:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004834de81/0xf210a9075089fece lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217133.103508:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004834de81/0xf210a9075089fece lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217133.103594:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004834de81/0xf210a9075089fece lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217133.103616:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217133.103619:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217133.103621:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217133.103689:0:14800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1782217133.103695:0:14800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004834de81/0xf210a9075089fece lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782217133.104396:0:14800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782217133.104403:0:14800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0c9ba42/0xf210a9075089fed5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.104425:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1782217133.104429:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217133.104434:0:14800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0c9ba42/0xf210a9075089fed5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.104454:0:14800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0c9ba42/0xf210a9075089fed5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.104463:0:14800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0c9ba42/0xf210a9075089fed5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217133.104471:0:14800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0c9ba42/0xf210a9075089fed5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217133.104587:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782217133.104594:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0c9ba42/0xf210a9075089fed5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217133.104602:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e5410b0600 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:2.0:1782217133.104607:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0c9ba42/0xf210a9075089fed5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217133.104616:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0c9ba42/0xf210a9075089fed5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217133.104629:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0c9ba42/0xf210a9075089fed5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217133.104638:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217133.104640:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217133.104642:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217133.104707:0:14800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1782217133.104713:0:14800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0c9ba42/0xf210a9075089fed5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1782217133.105143:0:14800:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:1.0:1782217133.105279:0:14800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f79ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14187:x1868789734018048:12345-0@lo:5:osp-pre-1-0.0 Request processed in 85972us (86130us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217133.105291:0:14800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782217133.105412:0:14187:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f79ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14187:1868789734018048:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1782217133.105433:0:14187:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:3.0:1782217133.105511:0:14187:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67420d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14187:1868789734018176:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1782217133.105573:0:14187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217133.105641:0:14187:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e652c80cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782217133.105749:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734018176 00000100:00100000:1.0:1782217133.105758:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734018176 00000100:00100000:1.0:1782217133.105815:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782217133.105826:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67420c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14187:x1868789734018176:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1782217133.105927:0:14798:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:2.0:1782217133.109684:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217133.121098:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67420c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14187:x1868789734018176:12345-0@lo:5:osp-pre-1-0.0 Request processed in 15266us (15517us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1782217133.121183:0:14187:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67420d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14187:1868789734018176:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1782217133.121184:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000004:00080000:2.0:1782217133.121215:0:14187:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:1.0:1782217133.588078:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782217133.604076:0:7488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1782217133.604158:0:7488:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1782217134.612120:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782217135.326527:0:15826:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg319-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1782217135.581080:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789734018304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782217135.581149:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217135.581234:0:14803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734018304 00000100:00100000:2.0:1782217135.581241:0:14803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734018304 00000100:00100000:2.0:1782217135.581294:0:14803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782217135.581303:0:14803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789734018304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782217135.581337:0:14803:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782217135.581382:0:14803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789734018304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217135.581389:0:14803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1782217135.581408:0:14158:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782217135.581451:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789734018304:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782217135.636068:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217136.660311:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217137.598266:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217137.598369:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714100224 00000100:00100000:1.0:1782217137.598384:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714100224 00000100:00100000:1.0:1782217137.598461:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 77 00000100:00100000:1.0:1782217137.598472:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f2b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2355:x1868789714100224:12345-192.168.203.19@tcp:250:mount.lustre.0 00010000:00080000:1.0:1782217137.598728:0:14157:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 1f0dd3e5-488b-4209-a0f7-377d359c4f44@192.168.203.19@tcp t0 exp 0000000000000000 cur 456 last 0 00000020:00000080:1.0:1782217137.598774:0:14157:0:(genops.c:1406:class_connect()) connect: client 1f0dd3e5-488b-4209-a0f7-377d359c4f44, cookie 0xf210a9075089fedc 00000100:00080000:0.0:1782217137.599250:0:14157:0:(import.c:65:import_set_state_nolock()) ffff88e6488d0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782217137.599346:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f2b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f0dd3e5-488b-4209-a0f7-377d359c4f44+5:2355:x1868789714100224:12345-192.168.203.19@tcp:250:mount.lustre.0 Request processed in 873us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217137.599356:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 77 00000100:00100000:2.0:1782217137.604280:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217137.608661:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714100352 00000100:00100000:0.0:1782217137.608683:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714100352 00000100:00100000:0.0:1782217137.608792:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 78 00000100:00100000:0.0:1782217137.608805:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f2b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f0dd3e5-488b-4209-a0f7-377d359c4f44+5:13720:x1868789714100352:12345-192.168.203.19@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782217137.608828:0:14155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217137.608851:0:14155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e67437b200/0xf210a9075089fee3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620625 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217137.608952:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e67437b200/0xf210a9075089fee3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620625 expref: 6 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217137.608966:0:14155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e67437b200/0xf210a9075089fee3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620625 expref: 6 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217137.608977:0:14155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437b200, rc 0) 00000100:00100000:0.0:1782217137.609080:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f2b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f0dd3e5-488b-4209-a0f7-377d359c4f44+6:13720:x1868789714100352:12345-192.168.203.19@tcp:101:mount.lustre.0 Request processed in 278us (4815us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217137.610002:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 78 00000100:00100000:3.0:1782217137.619041:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217137.619521:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714100480 00000100:00100000:0.0:1782217137.619534:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714100480 00000100:00100000:0.0:1782217137.619616:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 79 00000100:00100000:0.0:1782217137.619660:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f2b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f0dd3e5-488b-4209-a0f7-377d359c4f44+6:13720:x1868789714100480:12345-192.168.203.19@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782217137.620774:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f2b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f0dd3e5-488b-4209-a0f7-377d359c4f44+6:13720:x1868789714100480:12345-192.168.203.19@tcp:501:mount.lustre.0 Request processed in 1119us (1748us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782217137.620792:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 79 00000100:00100000:3.0:1782217137.628114:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217137.628232:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714100608 00000100:00100000:2.0:1782217137.628245:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714100608 00000100:00100000:2.0:1782217137.628320:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 80 00000100:00100000:2.0:1782217137.628332:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f2b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f0dd3e5-488b-4209-a0f7-377d359c4f44+6:13720:x1868789714100608:12345-192.168.203.19@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782217137.628354:0:14156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217137.628376:0:14156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e6738afe00/0xf210a9075089feea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62062c expref: -99 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217137.628422:0:14156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e6738afe00/0xf210a9075089feea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62062c expref: 7 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217137.628436:0:14156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e6738afe00/0xf210a9075089feea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62062c expref: 7 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217137.628447:0:14156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738afe00, rc 0) 00000100:00100000:2.0:1782217137.628533:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f2b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f0dd3e5-488b-4209-a0f7-377d359c4f44+7:13720:x1868789714100608:12345-192.168.203.19@tcp:101:mount.lustre.0 Request processed in 202us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217137.628561:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 80 00000100:00100000:3.0:1782217137.630511:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217137.630580:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714100736 00000100:00100000:0.0:1782217137.630591:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714100736 00000100:00100000:0.0:1782217137.630665:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 81 00000100:00100000:0.0:1782217137.630676:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f2b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f0dd3e5-488b-4209-a0f7-377d359c4f44+7:13720:x1868789714100736:12345-192.168.203.19@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782217137.631184:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f2b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f0dd3e5-488b-4209-a0f7-377d359c4f44+8:13720:x1868789714100736:12345-192.168.203.19@tcp:501:mount.lustre.0 Request processed in 506us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217137.631195:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 81 00000100:00100000:2.0:1782217137.649866:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217137.650024:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714100864 00000100:00100000:0.0:1782217137.650037:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714100864 00000100:00100000:0.0:1782217137.650245:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 82 00000100:00100000:0.0:1782217137.650258:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f2b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f0dd3e5-488b-4209-a0f7-377d359c4f44+8:13720:x1868789714100864:12345-192.168.203.19@tcp:503:mount.lustre.0 00000100:00100000:0.0:1782217137.650867:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f2b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f0dd3e5-488b-4209-a0f7-377d359c4f44+8:13720:x1868789714100864:12345-192.168.203.19@tcp:503:mount.lustre.0 Request processed in 609us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217137.650909:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 82 00000100:00100000:3.0:1782217137.663736:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217137.663911:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714100992 00000100:00100000:2.0:1782217137.663924:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714100992 00000100:00100000:2.0:1782217137.663995:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 83 00000100:00100000:2.0:1782217137.664007:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6644d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f0dd3e5-488b-4209-a0f7-377d359c4f44+8:13738:x1868789714100992:12345-192.168.203.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782217137.664486:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6644d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f0dd3e5-488b-4209-a0f7-377d359c4f44+8:13738:x1868789714100992:12345-192.168.203.19@tcp:502:llog_process_th.0 Request processed in 479us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217137.664496:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 83 00000100:00100000:3.0:1782217137.679526:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217137.679968:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714101120 00000100:00100000:0.0:1782217137.679983:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714101120 00000100:00100000:0.0:1782217137.680062:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 84 00000100:00100000:0.0:1782217137.680075:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6644d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f0dd3e5-488b-4209-a0f7-377d359c4f44+8:13738:x1868789714101120:12345-192.168.203.19@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782217137.682971:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6644d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f0dd3e5-488b-4209-a0f7-377d359c4f44+8:13738:x1868789714101120:12345-192.168.203.19@tcp:502:llog_process_th.0 Request processed in 2882us (3446us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217137.683006:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 84 00010000:00010000:1.0:1782217137.684110:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782217137.717204:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217137.717421:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714101248 00000100:00100000:3.0:1782217137.717434:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714101248 00000100:00100000:3.0:1782217137.717502:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 85 00000100:00100000:3.0:1782217137.717515:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6644d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f0dd3e5-488b-4209-a0f7-377d359c4f44+8:13720:x1868789714101248:12345-192.168.203.19@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782217137.717539:0:14157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217137.717565:0:14157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e682171400/0xf210a9075089fef1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620656 expref: -99 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217137.717601:0:14157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e682171400/0xf210a9075089fef1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620656 expref: 9 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217137.717614:0:14157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e682171400/0xf210a9075089fef1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620656 expref: 9 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217137.717643:0:14157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e682171400, rc 0) 00000100:00100000:3.0:1782217137.717729:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6644d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f0dd3e5-488b-4209-a0f7-377d359c4f44+9:13720:x1868789714101248:12345-192.168.203.19@tcp:101:mount.lustre.0 Request processed in 216us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217137.717736:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 85 00000100:00100000:3.0:1782217137.725554:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217137.726077:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714101376 00000100:00100000:0.0:1782217137.726100:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714101376 00000100:00100000:0.0:1782217137.726175:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 86 00000100:00100000:0.0:1782217137.726187:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6644d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f0dd3e5-488b-4209-a0f7-377d359c4f44+9:13720:x1868789714101376:12345-192.168.203.19@tcp:256:mount.lustre.0 20000000:01000000:0.0:1782217137.726221:0:14155:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1782217137.726254:0:14155:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1782217137.726260:0:14155:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1782217137.726263:0:14155:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1782217137.726266:0:14155:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1782217137.729578:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6644d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f0dd3e5-488b-4209-a0f7-377d359c4f44+9:13720:x1868789714101376:12345-192.168.203.19@tcp:256:mount.lustre.0 Request processed in 3377us (4021us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217137.729598:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 86 00000100:00100000:3.0:1782217137.732867:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217137.732988:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714101504 00000100:00100000:2.0:1782217137.733000:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714101504 00000100:00100000:2.0:1782217137.733076:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 87 00000100:00100000:2.0:1782217137.733097:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6644d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f0dd3e5-488b-4209-a0f7-377d359c4f44+9:13720:x1868789714101504:12345-192.168.203.19@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782217137.733119:0:14156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217137.733141:0:14156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e6738ae000/0xf210a9075089fef8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62065d expref: -99 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217137.733174:0:14156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e6738ae000/0xf210a9075089fef8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62065d expref: 10 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217137.733185:0:14156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e6738ae000/0xf210a9075089fef8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62065d expref: 10 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217137.733196:0:14156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738ae000, rc 0) 00000100:00100000:2.0:1782217137.733793:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6644d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f0dd3e5-488b-4209-a0f7-377d359c4f44+10:13720:x1868789714101504:12345-192.168.203.19@tcp:101:mount.lustre.0 Request processed in 702us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217137.733824:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 87 00000100:00100000:3.0:1782217137.736421:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217137.736539:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714101632 00000100:00100000:1.0:1782217137.736552:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714101632 00000100:00100000:1.0:1782217137.736623:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 88 00000100:00100000:1.0:1782217137.736636:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6644d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f0dd3e5-488b-4209-a0f7-377d359c4f44+10:13720:x1868789714101632:12345-192.168.203.19@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782217137.737503:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6644d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f0dd3e5-488b-4209-a0f7-377d359c4f44+10:13720:x1868789714101632:12345-192.168.203.19@tcp:501:mount.lustre.0 Request processed in 860us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217137.737517:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 88 00000100:00100000:1.0:1782217137.741642:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217137.743824:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714101760 00000100:00100000:2.0:1782217137.743844:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714101760 00000100:00100000:2.0:1782217137.744074:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 89 00000100:00100000:2.0:1782217137.744087:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6644d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f0dd3e5-488b-4209-a0f7-377d359c4f44+10:13720:x1868789714101760:12345-192.168.203.19@tcp:503:mount.lustre.0 00000100:00100000:2.0:1782217137.745368:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6644d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f0dd3e5-488b-4209-a0f7-377d359c4f44+10:13720:x1868789714101760:12345-192.168.203.19@tcp:503:mount.lustre.0 Request processed in 688us (3145us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217137.745385:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 89 00000100:00100000:0.0:1782217137.752468:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217137.753333:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714101888 00000100:00100000:3.0:1782217137.753347:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714101888 00000100:00100000:3.0:1782217137.753441:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 90 00000100:00100000:3.0:1782217137.753454:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6644d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f0dd3e5-488b-4209-a0f7-377d359c4f44+10:13743:x1868789714101888:12345-192.168.203.19@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782217137.753855:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6644d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f0dd3e5-488b-4209-a0f7-377d359c4f44+10:13743:x1868789714101888:12345-192.168.203.19@tcp:502:llog_process_th.0 Request processed in 401us (1399us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217137.753865:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 90 00000100:00100000:3.0:1782217137.758697:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217137.759758:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714102016 00000100:00100000:1.0:1782217137.759775:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714102016 00000100:00100000:1.0:1782217137.760073:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 91 00000100:00100000:1.0:1782217137.760259:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6644d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f0dd3e5-488b-4209-a0f7-377d359c4f44+10:13743:x1868789714102016:12345-192.168.203.19@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782217137.760598:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6644d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f0dd3e5-488b-4209-a0f7-377d359c4f44+10:13743:x1868789714102016:12345-192.168.203.19@tcp:502:llog_process_th.0 Request processed in 512us (1914us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217137.760608:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 91 00000100:00100000:1.0:1782217137.786804:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217137.787496:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714102144 00000100:00100000:2.0:1782217137.787510:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714102144 00000100:00100000:2.0:1782217137.787568:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 4 00000100:00100000:2.0:1782217137.787578:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2355:x1868789714102144:12345-192.168.203.19@tcp:38:mount.lustre.0 00010000:00080000:2.0:1782217137.787618:0:14163:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from c14a2bd2-9e0a-4abc-8384-4a27a4f07c70@192.168.203.19@tcp t0 exp 0000000000000000 cur 456 last 0 00000020:00000080:2.0:1782217137.787683:0:14163:0:(genops.c:1406:class_connect()) connect: client c14a2bd2-9e0a-4abc-8384-4a27a4f07c70, cookie 0xf210a9075089feff 00000004:00100000:2.0:1782217137.787722:0:14163:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1782217137.787729:0:14163:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1782217137.856602:0:14163:0:(import.c:65:import_set_state_nolock()) ffff88e67f2ab800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782217137.856776:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+6:2355:x1868789714102144:12345-192.168.203.19@tcp:38:mount.lustre.0 Request processed in 69195us (69986us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217137.856790:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 4 00000100:00100000:0.0:1782217137.859582:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217137.859631:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217137.860870:0:15334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714102272 00000100:00100000:2.0:1782217137.860902:0:15334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714102272 00000100:00100000:2.0:1782217137.861077:0:15334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714102400 00000100:00100000:2.0:1782217137.861082:0:15334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714102400 00000100:00100000:2.0:1782217137.861116:0:15334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 5 00000100:00100000:2.0:1782217137.861129:0:15334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f79f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+7:0:x1868789714102272:12345-192.168.203.19@tcp:41:mount.lustre.0 00000004:00000024:2.0:1782217137.861214:0:15334:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1782217137.861617:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 6 00000100:00100000:0.0:1782217137.861631:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f79c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+7:13720:x1868789714102400:12345-192.168.203.19@tcp:41:mount.lustre.0 00000004:00000024:0.0:1782217137.861648:0:14164:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1782217137.861774:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f79c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+7:13720:x1868789714102400:12345-192.168.203.19@tcp:41:mount.lustre.0 Request processed in 146us (2141us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217137.861782:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 6 00000100:00080000:3.0:1782217137.861897:0:14158:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782217137.863324:0:15334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f79f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+6:0:x1868789714102272:12345-192.168.203.19@tcp:41:mount.lustre.0 Request processed in 2186us (3746us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217137.863338:0:15334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 5 00000100:00100000:1.0:1782217137.863824:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217137.864452:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714102528 00000100:00100000:2.0:1782217137.864464:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714102528 00000100:00100000:2.0:1782217137.864519:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 7 00000100:00100000:2.0:1782217137.864528:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+6:13720:x1868789714102528:12345-192.168.203.19@tcp:40:mount.lustre.0 00000100:00100000:2.0:1782217137.864616:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+6:13720:x1868789714102528:12345-192.168.203.19@tcp:40:mount.lustre.0 Request processed in 89us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217137.864623:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 7 00000100:00100000:1.0:1782217137.871769:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217137.871816:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217137.871870:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217137.871946:0:14800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714102656 00000100:00100000:0.0:1782217137.871961:0:14800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714102656 00000100:00100000:0.0:1782217137.872022:0:14800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714102784 00000100:00100000:0.0:1782217137.872027:0:14800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714102784 00000100:00100000:3.0:1782217137.872045:0:14801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 8 00000100:00100000:3.0:1782217137.872060:0:14801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1868789714102656:12345-192.168.203.19@tcp:8:mount.lustre.0 00000100:00100000:0.0:1782217137.872068:0:14800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 9 00000100:00100000:0.0:1782217137.872080:0:14800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1868789714102784:12345-192.168.203.19@tcp:8:mount.lustre.0 00010000:00080000:3.0:1782217137.872110:0:14801:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from c14a2bd2-9e0a-4abc-8384-4a27a4f07c70@192.168.203.19@tcp t0 exp 0000000000000000 cur 456 last 0 00010000:00080000:0.0:1782217137.872120:0:14800:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from c14a2bd2-9e0a-4abc-8384-4a27a4f07c70@192.168.203.19@tcp t0 exp 0000000000000000 cur 456 last 0 00000020:00000080:3.0:1782217137.872159:0:14801:0:(genops.c:1406:class_connect()) connect: client c14a2bd2-9e0a-4abc-8384-4a27a4f07c70, cookie 0xf210a9075089ff06 00000020:00000080:0.0:1782217137.872174:0:14800:0:(genops.c:1406:class_connect()) connect: client c14a2bd2-9e0a-4abc-8384-4a27a4f07c70, cookie 0xf210a9075089ff0d 00002000:00100000:3.0:1782217137.872177:0:14801:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c14a2bd2-9e0a-4abc-8384-4a27a4f07c70/ffff88e541a34000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782217137.872189:0:14800:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c14a2bd2-9e0a-4abc-8384-4a27a4f07c70/ffff88e6488d3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782217137.872210:0:14801:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00100000:0.0:1782217137.872219:0:14800:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782217137.873014:0:14801:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00002000:00080000:0.0:1782217137.873023:0:14800:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1782217137.873067:0:14800:0:(import.c:65:import_set_state_nolock()) ffff88e6488d4800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1782217137.873070:0:14801:0:(import.c:65:import_set_state_nolock()) ffff88e541a37000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782217137.873169:0:14801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+6:2355:x1868789714102656:12345-192.168.203.19@tcp:8:mount.lustre.0 Request processed in 1108us (1349us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217137.873180:0:14801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 8 00000100:00100000:2.0:1782217137.873377:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714102912 00000100:00100000:2.0:1782217137.873386:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714102912 00000100:00100000:2.0:1782217137.873436:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 0 00000100:00100000:2.0:1782217137.873448:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+6:13720:x1868789714102912:12345-192.168.203.19@tcp:33:mount.lustre.0 00000100:00100000:0.0:1782217137.873599:0:14800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+6:2355:x1868789714102784:12345-192.168.203.19@tcp:8:mount.lustre.0 Request processed in 1518us (1729us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217137.873608:0:14800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 9 00000004:00080000:3.0:1782217137.875726:0:14165:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2213us 00000004:00200000:2.0:1782217137.907565:0:14165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1782217137.907794:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+6:13720:x1868789714102912:12345-192.168.203.19@tcp:33:mount.lustre.0 Request processed in 34340us (36033us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217137.907808:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 0 00000100:00100000:1.0:1782217138.112711:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217138.112861:0:15334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714103040 00000100:00100000:2.0:1782217138.112891:0:15334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714103040 00000100:00100000:2.0:1782217138.112974:0:15334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 8 00000100:00100000:2.0:1782217138.112986:0:15334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+6:13764:x1868789714103040:12345-192.168.203.19@tcp:101:mkdir.0 00010000:00010000:2.0:1782217138.113014:0:15334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217138.113048:0:15334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aea00/0xf210a9075089ff14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620687 expref: -99 pid: 15334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217138.113270:0:15334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089ff1b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217138.113287:0:15334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089ff1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217138.113302:0:15334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089ff1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217138.113687:0:15334:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782217138.113693:0:15334:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1782217138.113798:0:15334:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089ff1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217138.113832:0:15334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738aea00/0xf210a9075089ff14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620687 expref: 8 pid: 15334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217138.113853:0:15334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089ff1b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620687 expref: 7 pid: 15334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217138.113864:0:15334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e65417f600) 00010000:00010000:2.0:1782217138.113867:0:15334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782217138.113872:0:15334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738af400, rc 0) 00000100:00100000:2.0:1782217138.115371:0:15334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+7:13764:x1868789714103040:12345-192.168.203.19@tcp:101:mkdir.0 Request processed in 2376us (2665us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217138.115398:0:15334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 8 00000100:00100000:1.0:1782217138.132341:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789734018432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782217138.132471:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217138.132674:0:14802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734018432 00000100:00100000:2.0:1782217138.132685:0:14802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734018432 00000100:00100000:2.0:1782217138.132788:0:14802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782217138.132799:0:14802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664486d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789734018432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782217138.132830:0:14802:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782217138.132918:0:14802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664486d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789734018432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217138.132926:0:14802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1782217138.133125:0:14158:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782217138.133160:0:3304:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1782217138.133187:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789734018432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782217138.134840:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f79ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868789734018816:0@lo:400:kworker.0 00000100:00100000:3.0:1782217138.134959:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217138.135005:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782217138.135012:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f79f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1868789734018944:0@lo:400:kworker.0 00000100:00100000:3.0:1782217138.135036:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217138.135481:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734018816 00000100:00100000:0.0:1782217138.135491:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734018816 00000100:00100000:0.0:1782217138.135551:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734018944 00000100:00100000:0.0:1782217138.135554:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734018944 00000100:00100000:0.0:1782217138.135591:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782217138.135602:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67420c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868789734018816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217138.135680:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67420c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868789734018816:12345-0@lo:400:kworker.0 Request processed in 80us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217138.135688:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782217138.135707:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782217138.135713:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67420e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868789734018944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217138.135742:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67420e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868789734018944:12345-0@lo:400:kworker.0 Request processed in 30us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217138.135748:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782217138.136235:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f79d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789734018688:0@lo:400:kworker.0 00000100:00100000:1.0:1782217138.136283:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217138.136314:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782217138.136321:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f79c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:713996b4-9a75-4cc4-875d-de8926ad5952:3302:1868789734018560:0@lo:400:kworker.0 00000100:00100000:1.0:1782217138.136355:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217138.136393:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67f79df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1868789734019072:0@lo:400:kworker.0 00000100:00100000:1.0:1782217138.136425:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217138.136454:0:15336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734018688 00000100:00100000:1.0:1782217138.136460:0:15336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734018688 00000100:00100000:1.0:1782217138.136511:0:15336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782217138.136518:0:15336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789734018688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217138.136559:0:15336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789734018688:12345-0@lo:400:kworker.0 Request processed in 41us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217138.136565:0:15336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1782217138.136591:0:14158:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782217138.136596:0:14158:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782217138.136632:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f79d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789734018688:0@lo:400:kworker.0 00000100:00100000:1.0:1782217138.136671:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734019072 00000100:00100000:1.0:1782217138.136675:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734019072 00000100:00100000:1.0:1782217138.136701:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782217138.136707:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1868789734019072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217138.136741:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1868789734019072:12345-0@lo:400:kworker.0 Request processed in 34us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217138.136747:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1782217138.136760:0:14158:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782217138.136777:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f79df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1868789734019072:0@lo:400:kworker.0 00000100:00100000:0.0:1782217138.137707:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f79f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1868789734018944:0@lo:400:kworker.0 00000100:00100000:0.0:1782217138.137726:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f79ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868789734018816:0@lo:400:kworker.0 00000100:00100000:0.0:1782217138.137765:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734018560 00000100:00100000:0.0:1782217138.137781:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734018560 00000100:00100000:0.0:1782217138.137820:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1782217138.137828:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6644d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+19:3302:x1868789734018560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217138.137919:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6644d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+19:3302:x1868789734018560:12345-0@lo:400:kworker.0 Request processed in 91us (1562us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217138.137927:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1782217138.139504:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67f79c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:713996b4-9a75-4cc4-875d-de8926ad5952:3302:1868789734018560:0@lo:400:kworker.0 00000001:00100000:2.0:1782217138.702860:0:7488:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c14a2bd2-9e0a-4abc-8384-4a27a4f07c70 00010000:00010000:3.0:1782217138.709919:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1782217139.719359:0:6609:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c14a2bd2-9e0a-4abc-8384-4a27a4f07c70 00010000:00010000:1.0:1782217139.732236:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217140.019943:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217140.023346:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714103168 00000100:00100000:1.0:1782217140.023368:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714103168 00000100:00100000:1.0:1782217140.023693:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 9 00000100:00100000:1.0:1782217140.023709:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67420c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+7:13816:x1868789714103168:12345-192.168.203.19@tcp:41:lfs.0 00000004:00000024:1.0:1782217140.023771:0:14164:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1782217140.023925:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67420c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+7:13816:x1868789714103168:12345-192.168.203.19@tcp:41:lfs.0 Request processed in 220us (3997us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217140.023955:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 9 00000100:00080000:2.0:1782217140.026211:0:14158:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782217140.033658:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217140.033800:0:15335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714103296 00000100:00100000:2.0:1782217140.033816:0:15335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714103296 00000100:00100000:2.0:1782217140.033995:0:15335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 5 00000100:00100000:2.0:1782217140.034009:0:15335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+5:13816:x1868789714103296:12345-192.168.203.19@tcp:13:lfs.0 00002000:00000024:2.0:1782217140.034062:0:15335:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782217140.034185:0:15335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+5:13816:x1868789714103296:12345-192.168.203.19@tcp:13:lfs.0 Request processed in 174us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217140.034193:0:15335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 5 00000100:00080000:1.0:1782217140.034709:0:14158:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782217140.037098:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217140.037193:0:14803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714103424 00000100:00100000:1.0:1782217140.037205:0:14803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714103424 00000100:00100000:1.0:1782217140.037286:0:14803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 6 00000100:00100000:1.0:1782217140.037298:0:14803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+5:13816:x1868789714103424:12345-192.168.203.19@tcp:13:lfs.0 00002000:00000024:1.0:1782217140.037348:0:14803:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782217140.037463:0:14803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+5:13816:x1868789714103424:12345-192.168.203.19@tcp:13:lfs.0 Request processed in 167us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217140.037471:0:14803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 6 00000100:00080000:0.0:1782217140.038859:0:14158:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782217140.185333:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217140.185592:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714103552 00000100:00100000:2.0:1782217140.185607:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714103552 00000100:00100000:2.0:1782217140.185694:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 93 00000100:00100000:2.0:1782217140.185706:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6644d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f0dd3e5-488b-4209-a0f7-377d359c4f44+10:13847:x1868789714103552:12345-192.168.203.19@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782217140.185728:0:14156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217140.185751:0:14156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e6738aea00/0xf210a9075089ff22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62068e expref: -99 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217140.185789:0:14156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e6738aea00/0xf210a9075089ff22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62068e expref: 11 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217140.185827:0:14156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e6738aea00/0xf210a9075089ff22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62068e expref: 11 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217140.185838:0:14156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738aea00, rc 0) 00000100:00100000:2.0:1782217140.190802:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6644d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f0dd3e5-488b-4209-a0f7-377d359c4f44+11:13847:x1868789714103552:12345-192.168.203.19@tcp:101:mount.lustre.0 Request processed in 5076us (5461us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217140.190820:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 93 00000100:00100000:1.0:1782217140.193792:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217140.194049:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714103680 00000100:00100000:0.0:1782217140.194062:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714103680 00000100:00100000:0.0:1782217140.194181:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 94 00000100:00100000:0.0:1782217140.194194:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6644d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f0dd3e5-488b-4209-a0f7-377d359c4f44+11:13847:x1868789714103680:12345-192.168.203.19@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782217140.194631:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6644d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f0dd3e5-488b-4209-a0f7-377d359c4f44+11:13847:x1868789714103680:12345-192.168.203.19@tcp:501:mount.lustre.0 Request processed in 439us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217140.194640:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 94 00000100:00100000:1.0:1782217140.200410:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217140.200567:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714103808 00000100:00100000:2.0:1782217140.200581:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714103808 00000100:00100000:2.0:1782217140.200650:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 95 00000100:00100000:2.0:1782217140.200662:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6644d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f0dd3e5-488b-4209-a0f7-377d359c4f44+11:13847:x1868789714103808:12345-192.168.203.19@tcp:503:mount.lustre.0 00000100:00100000:2.0:1782217140.201323:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6644d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f0dd3e5-488b-4209-a0f7-377d359c4f44+11:13847:x1868789714103808:12345-192.168.203.19@tcp:503:mount.lustre.0 Request processed in 658us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217140.201335:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 95 00000100:00100000:1.0:1782217140.217167:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217140.217327:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714103936 00000100:00100000:2.0:1782217140.217340:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714103936 00000100:00100000:2.0:1782217140.217417:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 96 00000100:00100000:2.0:1782217140.217428:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6434db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f0dd3e5-488b-4209-a0f7-377d359c4f44+11:13854:x1868789714103936:12345-192.168.203.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782217140.217771:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6434db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f0dd3e5-488b-4209-a0f7-377d359c4f44+11:13854:x1868789714103936:12345-192.168.203.19@tcp:502:llog_process_th.0 Request processed in 343us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217140.217780:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 96 00000100:00100000:1.0:1782217140.233668:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217140.235348:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714104064 00000100:00100000:0.0:1782217140.235369:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714104064 00000100:00100000:2.0:1782217140.235619:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 97 00000100:00100000:2.0:1782217140.235634:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6434d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f0dd3e5-488b-4209-a0f7-377d359c4f44+11:13854:x1868789714104064:12345-192.168.203.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782217140.236426:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6434d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f0dd3e5-488b-4209-a0f7-377d359c4f44+11:13854:x1868789714104064:12345-192.168.203.19@tcp:502:llog_process_th.0 Request processed in 789us (2767us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217140.236448:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 97 00000100:00100000:1.0:1782217140.242698:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217140.244616:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714104192 00000100:00100000:3.0:1782217140.244638:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714104192 00000100:00100000:2.0:1782217140.245730:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 98 00000100:00100000:2.0:1782217140.245750:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6434d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f0dd3e5-488b-4209-a0f7-377d359c4f44+11:13847:x1868789714104192:12345-192.168.203.19@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782217140.245775:0:14157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217140.245798:0:14157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e6738aec00/0xf210a9075089ff29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6206b8 expref: -99 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217140.245837:0:14157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e6738aec00/0xf210a9075089ff29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6206b8 expref: 12 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217140.245850:0:14157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e6738aec00/0xf210a9075089ff29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6206b8 expref: 12 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217140.245860:0:14157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738aec00, rc 0) 00000100:00100000:2.0:1782217140.246304:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6434d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f0dd3e5-488b-4209-a0f7-377d359c4f44+12:13847:x1868789714104192:12345-192.168.203.19@tcp:101:mount.lustre.0 Request processed in 557us (3617us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217140.246314:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 98 00000100:00100000:1.0:1782217140.255478:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217140.255639:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714104320 00000100:00100000:2.0:1782217140.255652:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714104320 00000100:00100000:2.0:1782217140.255738:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 99 00000100:00100000:2.0:1782217140.255750:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6434da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f0dd3e5-488b-4209-a0f7-377d359c4f44+12:13847:x1868789714104320:12345-192.168.203.19@tcp:256:mount.lustre.0 20000000:01000000:2.0:1782217140.255788:0:14155:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1782217140.255823:0:14155:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1782217140.255827:0:14155:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1782217140.255830:0:14155:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1782217140.255832:0:14155:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1782217140.258817:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6434da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f0dd3e5-488b-4209-a0f7-377d359c4f44+12:13847:x1868789714104320:12345-192.168.203.19@tcp:256:mount.lustre.0 Request processed in 3053us (3338us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217140.258836:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 99 00000100:00100000:1.0:1782217140.269030:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217140.269198:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714104448 00000100:00100000:2.0:1782217140.269212:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714104448 00000100:00100000:2.0:1782217140.269293:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 100 00000100:00100000:2.0:1782217140.269306:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6434d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f0dd3e5-488b-4209-a0f7-377d359c4f44+12:13847:x1868789714104448:12345-192.168.203.19@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782217140.269329:0:14157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217140.269355:0:14157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e6738afa00/0xf210a9075089ff30 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6206bf expref: -99 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217140.269402:0:14157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e6738afa00/0xf210a9075089ff30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6206bf expref: 13 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217140.269417:0:14157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e6738afa00/0xf210a9075089ff30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6206bf expref: 13 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217140.269428:0:14157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738afa00, rc 0) 00000100:00100000:2.0:1782217140.269505:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6434d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f0dd3e5-488b-4209-a0f7-377d359c4f44+13:13847:x1868789714104448:12345-192.168.203.19@tcp:101:mount.lustre.0 Request processed in 200us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217140.269512:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 100 00000100:00100000:1.0:1782217140.271782:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217140.272256:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714104576 00000100:00100000:2.0:1782217140.272270:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714104576 00000100:00100000:2.0:1782217140.272342:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 101 00000100:00100000:2.0:1782217140.272354:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6434d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f0dd3e5-488b-4209-a0f7-377d359c4f44+13:13847:x1868789714104576:12345-192.168.203.19@tcp:501:mount.lustre.0 00000100:00100000:2.0:1782217140.273538:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6434d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f0dd3e5-488b-4209-a0f7-377d359c4f44+13:13847:x1868789714104576:12345-192.168.203.19@tcp:501:mount.lustre.0 Request processed in 1178us (1761us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217140.273565:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 101 00000100:00100000:1.0:1782217140.276708:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217140.277082:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714104704 00000100:00100000:0.0:1782217140.277095:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714104704 00000100:00100000:0.0:1782217140.277285:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 102 00000100:00100000:0.0:1782217140.277299:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6434d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f0dd3e5-488b-4209-a0f7-377d359c4f44+13:13847:x1868789714104704:12345-192.168.203.19@tcp:503:mount.lustre.0 00000100:00100000:0.0:1782217140.277605:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6434d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f0dd3e5-488b-4209-a0f7-377d359c4f44+13:13847:x1868789714104704:12345-192.168.203.19@tcp:503:mount.lustre.0 Request processed in 308us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217140.277614:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 102 00000100:00100000:1.0:1782217140.281148:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217140.281258:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714104832 00000100:00100000:2.0:1782217140.281271:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714104832 00000100:00100000:2.0:1782217140.281347:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 103 00000100:00100000:2.0:1782217140.281359:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6434db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f0dd3e5-488b-4209-a0f7-377d359c4f44+13:13857:x1868789714104832:12345-192.168.203.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782217140.281714:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6434db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f0dd3e5-488b-4209-a0f7-377d359c4f44+13:13857:x1868789714104832:12345-192.168.203.19@tcp:502:llog_process_th.0 Request processed in 356us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217140.281724:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 103 00000100:00100000:1.0:1782217140.286512:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217140.286863:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714104960 00000100:00100000:2.0:1782217140.287028:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714104960 00000100:00100000:2.0:1782217140.287102:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 104 00000100:00100000:2.0:1782217140.287499:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6434da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f0dd3e5-488b-4209-a0f7-377d359c4f44+13:13857:x1868789714104960:12345-192.168.203.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782217140.288551:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6434da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f0dd3e5-488b-4209-a0f7-377d359c4f44+13:13857:x1868789714104960:12345-192.168.203.19@tcp:502:llog_process_th.0 Request processed in 1431us (2046us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217140.288567:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 104 00000100:00100000:1.0:1782217140.305488:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217140.306162:0:15334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714105088 00000100:00100000:2.0:1782217140.306177:0:15334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714105088 00000100:00100000:2.0:1782217140.306243:0:15334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 10 00000100:00100000:2.0:1782217140.306254:0:15334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a800380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2355:x1868789714105088:12345-192.168.203.19@tcp:38:mount.lustre.0 00010000:00080000:2.0:1782217140.306294:0:15334:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b@192.168.203.19@tcp t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:2.0:1782217140.306349:0:15334:0:(genops.c:1406:class_connect()) connect: client 2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b, cookie 0xf210a9075089ff37 00000004:00100000:2.0:1782217140.306406:0:15334:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1782217140.306599:0:15334:0:(import.c:65:import_set_state_nolock()) ffff88e67389e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782217140.306699:0:15334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a800380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+6:2355:x1868789714105088:12345-192.168.203.19@tcp:38:mount.lustre.0 Request processed in 444us (1224us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217140.306715:0:15334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 10 00000100:00100000:1.0:1782217140.311022:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217140.311065:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217140.311258:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714105344 00000100:00100000:0.0:1782217140.311287:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714105344 00000100:00100000:0.0:1782217140.311369:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714105216 00000100:00100000:0.0:1782217140.311373:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714105216 00000100:00100000:0.0:1782217140.311413:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 11 00000100:00100000:0.0:1782217140.311424:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a800e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+7:13847:x1868789714105344:12345-192.168.203.19@tcp:41:mount.lustre.0 00000004:00000024:0.0:1782217140.311471:0:14164:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1782217140.311557:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a800e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+7:13847:x1868789714105344:12345-192.168.203.19@tcp:41:mount.lustre.0 Request processed in 135us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217140.311566:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 11 00000100:00100000:0.0:1782217140.311586:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 12 00000100:00100000:0.0:1782217140.311593:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a801f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+6:0:x1868789714105216:12345-192.168.203.19@tcp:41:mount.lustre.0 00000004:00000024:0.0:1782217140.311604:0:14164:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1782217140.311627:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a801f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+6:0:x1868789714105216:12345-192.168.203.19@tcp:41:mount.lustre.0 Request processed in 35us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217140.311632:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 12 00000100:00080000:1.0:1782217140.312314:0:14158:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782217140.319226:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217140.319390:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714105472 00000100:00100000:0.0:1782217140.319412:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714105472 00000100:00100000:0.0:1782217140.319496:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 13 00000100:00100000:0.0:1782217140.319509:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a800a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+6:13847:x1868789714105472:12345-192.168.203.19@tcp:40:mount.lustre.0 00000100:00100000:0.0:1782217140.319622:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a800a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+6:13847:x1868789714105472:12345-192.168.203.19@tcp:40:mount.lustre.0 Request processed in 115us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217140.319630:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 13 00000100:00100000:0.0:1782217140.334406:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217140.334459:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217140.334689:0:14800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714105600 00000100:00100000:1.0:1782217140.334702:0:14800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714105600 00000100:00100000:1.0:1782217140.334766:0:14800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714105728 00000100:00100000:1.0:1782217140.334770:0:14800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714105728 00000100:00100000:1.0:1782217140.334797:0:14800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 10 00000100:00100000:1.0:1782217140.334809:0:14800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f79f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1868789714105600:12345-192.168.203.19@tcp:8:mount.lustre.0 00010000:00080000:1.0:1782217140.334851:0:14800:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b@192.168.203.19@tcp t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:1.0:1782217140.334930:0:14800:0:(genops.c:1406:class_connect()) connect: client 2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b, cookie 0xf210a9075089ff3e 00002000:00100000:1.0:1782217140.334946:0:14800:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b/ffff88e65b98c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782217140.334961:0:14800:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782217140.335271:0:14800:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1782217140.335312:0:14800:0:(import.c:65:import_set_state_nolock()) ffff88e65b98f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782217140.335407:0:14800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f79f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+6:2355:x1868789714105600:12345-192.168.203.19@tcp:8:mount.lustre.0 Request processed in 599us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217140.335416:0:14800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 10 00000100:00100000:1.0:1782217140.335437:0:14800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 11 00000100:00100000:1.0:1782217140.335441:0:14800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f79d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1868789714105728:12345-192.168.203.19@tcp:8:mount.lustre.0 00010000:00080000:1.0:1782217140.335458:0:14800:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b@192.168.203.19@tcp t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:1.0:1782217140.335476:0:14800:0:(genops.c:1406:class_connect()) connect: client 2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b, cookie 0xf210a9075089ff45 00002000:00100000:1.0:1782217140.335482:0:14800:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b/ffff88e65b98b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782217140.335489:0:14800:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782217140.335636:0:14800:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1782217140.335651:0:14800:0:(import.c:65:import_set_state_nolock()) ffff88e65b98d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782217140.335676:0:14800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f79d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+6:2355:x1868789714105728:12345-192.168.203.19@tcp:8:mount.lustre.0 Request processed in 233us (1216us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217140.335701:0:14800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 11 00000100:00100000:1.0:1782217140.339412:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217140.340583:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714105856 00000100:00100000:3.0:1782217140.340601:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714105856 00000100:00100000:3.0:1782217140.340733:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 1 00000100:00100000:3.0:1782217140.340758:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a802a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+6:13847:x1868789714105856:12345-192.168.203.19@tcp:33:mount.lustre.0 00000004:00200000:3.0:1782217140.341177:0:14166:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1782217140.341360:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a802a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+6:13847:x1868789714105856:12345-192.168.203.19@tcp:33:mount.lustre.0 Request processed in 615us (1971us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217140.341379:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 1 00000100:00100000:1.0:1782217140.593849:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217140.594007:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714105984 00000100:00100000:3.0:1782217140.594022:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714105984 00000100:00100000:3.0:1782217140.594167:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 14 00000100:00100000:3.0:1782217140.594185:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a803800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+6:13878:x1868789714105984:12345-192.168.203.19@tcp:101:mkdir.0 00010000:00010000:3.0:1782217140.594233:0:14162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217140.594267:0:14162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171200/0xf210a9075089ff4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6206e9 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217140.594487:0:14162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139400/0xf210a9075089ff53 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217140.594506:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139400/0xf210a9075089ff53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217140.594523:0:14162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139400/0xf210a9075089ff53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217140.595118:0:14162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782217140.595126:0:14162:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1782217140.595526:0:14162:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139400/0xf210a9075089ff53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217140.595647:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e682171200/0xf210a9075089ff4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6206e9 expref: 8 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217140.595682:0:14162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139400/0xf210a9075089ff53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6206e9 expref: 7 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217140.595692:0:14162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e65417f600) 00010000:00010000:3.0:1782217140.595696:0:14162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782217140.595833:0:14162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e675139400, rc 0) 00000100:00100000:3.0:1782217140.596302:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a803800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+7:13878:x1868789714105984:12345-192.168.203.19@tcp:101:mkdir.0 Request processed in 2121us (2467us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217140.596313:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 14 00000100:00100000:1.0:1782217140.696310:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789734019200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782217140.696421:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217140.696751:0:14803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734019200 00000100:00100000:2.0:1782217140.696761:0:14803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734019200 00000100:00100000:2.0:1782217140.696855:0:14803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782217140.696867:0:14803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a801500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789734019200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782217140.696935:0:14803:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782217140.696997:0:14803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a801500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789734019200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217140.697004:0:14803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1782217140.699604:0:14158:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782217140.699709:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789734019200:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782217140.756234:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217141.780422:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782217142.102595:0:14196:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1782217142.804187:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782217143.255800:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a803480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:713996b4-9a75-4cc4-875d-de8926ad5952:3304:1868789734019456:0@lo:400:kworker.0 00000100:00100000:1.0:1782217143.255867:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217143.255922:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1868789734019968:0@lo:400:kworker.0 00000100:00100000:1.0:1782217143.255944:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217143.255968:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782217143.255973:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a802680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789734019328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782217143.255992:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217143.256005:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a801180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868789734019840:0@lo:400:kworker.0 00000100:00100000:1.0:1782217143.256020:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217143.256039:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a800700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789734019584:0@lo:400:kworker.0 00000100:00100000:1.0:1782217143.256065:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217143.256079:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1868789734020096:0@lo:400:kworker.0 00000100:00100000:2.0:1782217143.256305:0:15335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734019328 00000100:00100000:2.0:1782217143.256314:0:15335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734019328 00000100:00100000:1.0:1782217143.258424:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217143.258478:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782217143.258488:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789734019712:0@lo:400:kworker.0 00000100:00100000:1.0:1782217143.258536:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217143.258583:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734019456 00000100:00100000:1.0:1782217143.258589:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734019456 00000100:00100000:1.0:1782217143.258624:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1782217143.258632:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6434da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+19:3304:x1868789734019456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217143.258684:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6434da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+19:3304:x1868789734019456:12345-0@lo:400:kworker.0 Request processed in 52us (2817us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217143.258691:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1782217143.258721:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734019968 00000100:00100000:1.0:1782217143.258725:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734019968 00000100:00100000:1.0:1782217143.258753:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734019840 00000100:00100000:1.0:1782217143.258755:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734019840 00000100:00100000:1.0:1782217143.258766:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734020096 00000100:00100000:1.0:1782217143.258768:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734020096 00000100:00100000:1.0:1782217143.258780:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782217143.258785:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868789734019968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217143.258814:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868789734019968:12345-0@lo:400:kworker.0 Request processed in 29us (2869us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217143.258819:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782217143.258829:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782217143.258833:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a802d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868789734019840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217143.258854:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a802d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868789734019840:12345-0@lo:400:kworker.0 Request processed in 21us (2833us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217143.258858:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782217143.258866:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782217143.258871:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1868789734020096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217143.258912:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1868789734020096:12345-0@lo:400:kworker.0 Request processed in 41us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217143.258927:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782217143.258945:0:14800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734019584 00000100:00100000:1.0:1782217143.258948:0:14800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734019584 00000100:00100000:1.0:1782217143.258970:0:14800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734019712 00000100:00100000:1.0:1782217143.258972:0:14800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734019712 00000100:00100000:1.0:1782217143.258986:0:14800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782217143.258991:0:14800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a801c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789734019584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217143.259020:0:14800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a801c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789734019584:12345-0@lo:400:kworker.0 Request processed in 29us (2954us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217143.259024:0:14800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782217143.259033:0:14800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782217143.259038:0:14800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1868789734019712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217143.259060:0:14800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1868789734019712:12345-0@lo:400:kworker.0 Request processed in 22us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217143.259065:0:14800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782217143.259102:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a801180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868789734019840:0@lo:400:kworker.0 00000100:00100000:1.0:1782217143.259113:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a803480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:713996b4-9a75-4cc4-875d-de8926ad5952:3304:1868789734019456:0@lo:400:kworker.0 00000100:00100000:1.0:1782217143.259122:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1868789734019968:0@lo:400:kworker.0 00000100:00100000:1.0:1782217143.259158:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789734019712:0@lo:400:kworker.0 00000100:00100000:1.0:1782217143.259166:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a800700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789734019584:0@lo:400:kworker.0 00000100:00100000:1.0:1782217143.259175:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1868789734020096:0@lo:400:kworker.0 00000100:00100000:2.0:1782217143.259363:0:15335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782217143.259383:0:15335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789734019328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782217143.259412:0:15335:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782217143.259447:0:15335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868789734019328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (3453us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217143.259452:0:15335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782217143.260668:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a802680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1868789734019328:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1782217143.261214:0:14158:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782217143.261219:0:14158:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782217143.261221:0:14158:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:2.0:1782217143.340078:0:16032:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:3.0:1782217143.347452:0:5805:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b 00000001:00100000:3.0:1782217143.347465:0:5805:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c14a2bd2-9e0a-4abc-8384-4a27a4f07c70 00000001:00100000:3.0:1782217143.819069:0:7488:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b 00010000:00010000:2.0:1782217143.828143:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217144.858313:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1782217144.886208:0:6609:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b 00000100:00100000:0.0:1782217145.347991:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217145.348036:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217145.348061:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217145.348078:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217145.348095:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217145.348113:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217145.348134:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217145.348165:0:14800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714106368 00000100:00100000:0.0:1782217145.348177:0:14800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714106368 00000100:00100000:0.0:1782217145.348239:0:14800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714106880 00000100:00100000:0.0:1782217145.348242:0:14800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714106880 00000100:00100000:0.0:1782217145.348255:0:14800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714106496 00000100:00100000:0.0:1782217145.348257:0:14800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714106496 00000100:00100000:0.0:1782217145.348268:0:14800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714106752 00000100:00100000:0.0:1782217145.348270:0:14800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714106752 00000100:00100000:0.0:1782217145.348285:0:14800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 5 00000100:00100000:0.0:1782217145.348295:0:14800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f79c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+5:2359:x1868789714106368:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:0.0:1782217145.348400:0:14800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f79c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+5:2359:x1868789714106368:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 105us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217145.348409:0:14800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 5 00000100:00100000:0.0:1782217145.348429:0:14800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 6 00000100:00100000:0.0:1782217145.348436:0:14800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f79d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+5:2359:x1868789714106880:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:0.0:1782217145.348463:0:14800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f79d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+5:2359:x1868789714106880:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 28us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217145.348469:0:14800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 6 00000100:00100000:0.0:1782217145.348480:0:14800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 7 00000100:00100000:0.0:1782217145.348486:0:14800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+5:2359:x1868789714106496:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:0.0:1782217145.348524:0:14800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+5:2359:x1868789714106496:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 38us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217145.348530:0:14800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 7 00000100:00100000:0.0:1782217145.348543:0:14800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 8 00000100:00100000:0.0:1782217145.348549:0:14800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+5:2359:x1868789714106752:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:0.0:1782217145.348570:0:14800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+5:2359:x1868789714106752:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 22us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217145.348577:0:14800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 8 00000100:00100000:0.0:1782217145.348596:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714106624 00000100:00100000:0.0:1782217145.348600:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714106624 00000100:00100000:0.0:1782217145.348629:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714106240 00000100:00100000:0.0:1782217145.348632:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714106240 00000100:00100000:0.0:1782217145.348654:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 19 00000100:00100000:0.0:1782217145.348660:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f79df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+6:2359:x1868789714106624:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:0.0:1782217145.348692:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f79df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+6:2359:x1868789714106624:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 32us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217145.348699:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 19 00000100:00100000:0.0:1782217145.348709:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 20 00000100:00100000:0.0:1782217145.348716:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+6:2359:x1868789714106240:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:0.0:1782217145.348739:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+6:2359:x1868789714106240:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 24us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217145.348744:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 20 00000100:00080000:0.0:1782217145.348776:0:14158:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782217145.348782:0:14158:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782217145.348784:0:14158:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782217145.352738:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714106112 00000100:00100000:3.0:1782217145.352759:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714106112 00000100:00100000:3.0:1782217145.354823:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 106 00000100:00100000:3.0:1782217145.354848:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6434d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f0dd3e5-488b-4209-a0f7-377d359c4f44+13:2359:x1868789714106112:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:3.0:1782217145.355537:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6434d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f0dd3e5-488b-4209-a0f7-377d359c4f44+13:2359:x1868789714106112:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 694us (7557us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217145.355549:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 106 00000100:00100000:1.0:1782217145.815921:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789734020224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782217145.816044:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217145.816186:0:14803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734020224 00000100:00100000:2.0:1782217145.816196:0:14803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734020224 00000100:00100000:2.0:1782217145.816282:0:14803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782217145.816292:0:14803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789734020224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782217145.816340:0:14803:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782217145.816406:0:14803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789734020224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217145.816421:0:14803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1782217145.816578:0:14158:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782217145.816621:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789734020224:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782217145.876487:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782217146.320136:0:16184:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff0df8d290 20000000:00000080:1.0:1782217146.320162:0:16184:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88e65b983400 uarg=0000000000000000 20000000:01000000:1.0:1782217146.320211:0:16184:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1782217146.320219:0:16184:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1782217146.320224:0:16184:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1782217146.321737:0:16185:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1782217146.321968:0:16184:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1782217146.328366:0:16184:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1782217146.328445:0:16184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88e5410b1200/0xf210a9075089ff5a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217146.328480:0:16184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88e6738af800/0xf210a9075089fc51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089fc4a expref: 18 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217146.328491:0:16184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88e682170800/0xf210a9075089fc9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089fc97 expref: 18 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217146.328508:0:16184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88e682170400/0xf210a9075089fdd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089fdd2 expref: 18 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217146.328519:0:16184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88e6738ae000/0xf210a9075089fef8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62065d expref: 12 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217146.328538:0:16184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88e6738afa00/0xf210a9075089ff30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6206bf expref: 12 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217146.328547:0:16184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88e5410b1200/0xf210a9075089ff5a lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217146.328655:0:16184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88e6738afa00/0xf210a9075089ff30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6206bf expref: 12 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217146.328692:0:16184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88e6738afa00/0xf210a9075089ff30 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6206bf expref: 12 pid: 14157 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217146.328714:0:16184:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6508d8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16184:1868789734020352:192.168.203.19@tcp:104: 00010000:00010000:1.0:1782217146.329162:0:16184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88e6738ae000/0xf210a9075089fef8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62065d expref: 12 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217146.329172:0:16184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88e6738ae000/0xf210a9075089fef8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62065d expref: 12 pid: 14156 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217146.329182:0:16184:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6508da300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16184:1868789734020480:192.168.203.19@tcp:104: 00010000:00010000:1.0:1782217146.329215:0:16184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88e682170400/0xf210a9075089fdd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf210a9075089fdd2 expref: 18 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217146.329224:0:16184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88e682170400/0xf210a9075089fdd9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf210a9075089fdd2 expref: 18 pid: 14156 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217146.329234:0:16184:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6508dbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16184:1868789734020608:0@lo:104: 00000100:00100000:1.0:1782217146.329296:0:16184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782217146.329385:0:16184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88e682170800/0xf210a9075089fc9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf210a9075089fc97 expref: 18 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217146.329394:0:16184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88e682170800/0xf210a9075089fc9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf210a9075089fc97 expref: 18 pid: 14155 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217146.329416:0:16184:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6508d8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16184:1868789734020736:0@lo:104: 00000100:00100000:1.0:1782217146.329437:0:16184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782217146.331362:0:16184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88e6738af800/0xf210a9075089fc51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf210a9075089fc4a expref: 18 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217146.331383:0:16184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88e6738af800/0xf210a9075089fc51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf210a9075089fc4a expref: 18 pid: 14155 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217146.331396:0:16184:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6508dad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16184:1868789734020864:0@lo:104: 00000100:00100000:1.0:1782217146.331489:0:16184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217146.331966:0:14147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734020608 00000100:00100000:3.0:1782217146.331979:0:14147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734020608 00000100:00100000:3.0:1782217146.332036:0:14147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734020736 00000100:00100000:3.0:1782217146.332040:0:14147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734020736 00000100:00100000:3.0:1782217146.332058:0:14147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782217146.332068:0:14147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:713996b4-9a75-4cc4-875d-de8926ad5952+4:16184:x1868789734020608:12345-0@lo:104: 00010000:00010000:3.0:1782217146.332087:0:14147:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.119@tcp lock: ffff88e682170600/0xf210a9075089fdd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089fdd9 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217146.332281:0:14147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782217146.332289:0:14147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:713996b4-9a75-4cc4-875d-de8926ad5952+4:16184:x1868789734020608:12345-0@lo:104: Request processed in 222us (2993us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217146.332313:0:14147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782217146.332336:0:14147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782217146.332343:0:14147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:713996b4-9a75-4cc4-875d-de8926ad5952+3:16184:x1868789734020736:12345-0@lo:104: 00010000:00010000:3.0:1782217146.332363:0:14147:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.119@tcp lock: ffff88e67fd06800/0xf210a9075089fc97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089fc9e expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217146.333684:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782217146.333700:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e682170600/0xf210a9075089fdd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089fdd9 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217146.333712:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e682170600 already unused, calling callback (ffffffffc1d2fc20) 10000000:00010000:0.0:1782217146.333717:0:14152:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e682170600/0xf210a9075089fdd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf210a9075089fdd9 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217146.333727:0:14152:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e682170600/0xf210a9075089fdd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf210a9075089fdd9 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782217146.333735:0:14152:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e682170600/0xf210a9075089fdd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf210a9075089fdd9 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782217146.333741:0:14152:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1782217146.333769:0:14146:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1782217146.333792:0:14146:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00010000:00010000:0.0:1782217146.333796:0:14152:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: ffff88e682170600/0xf210a9075089fdd2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089fdd9 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217146.333801:0:14146:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:0.0:1782217146.333808:0:14152:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782217146.334048:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e682170600/0xf210a9075089fdd2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089fdd9 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217146.334054:0:14147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1782217146.334058:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e682170600/0xf210a9075089fdd2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089fdd9 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217146.334070:0:14147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:713996b4-9a75-4cc4-875d-de8926ad5952+3:16184:x1868789734020736:12345-0@lo:104: Request processed in 1722us (4626us total) trans 0 rc 0/0 00010000:00010000:0.0:1782217146.334080:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1782217146.334082:0:14147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1782217146.334086:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e67fd06800/0xf210a9075089fc97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089fc9e expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217146.334094:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67fd06800 already unused, calling callback (ffffffffc1d2fc20) 10000000:00010000:0.0:1782217146.334097:0:14152:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e67fd06800/0xf210a9075089fc97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf210a9075089fc9e expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217146.334109:0:14147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734020864 00000100:00100000:3.0:1782217146.334117:0:14147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734020864 00010000:00010000:0.0:1782217146.334122:0:14152:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e67fd06800/0xf210a9075089fc97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf210a9075089fc9e expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782217146.334130:0:14152:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e67fd06800/0xf210a9075089fc97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf210a9075089fc9e expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782217146.334142:0:14152:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1782217146.334150:0:14147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782217146.334161:0:14147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6743a0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:713996b4-9a75-4cc4-875d-de8926ad5952+3:16184:x1868789734020864:12345-0@lo:104: 00010000:00010000:0.0:1782217146.334163:0:14152:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: ffff88e67fd06800/0xf210a9075089fc97 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089fc9e expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217146.334173:0:14147:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.119@tcp lock: ffff88e67437aa00/0xf210a9075089fc4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089fc51 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217146.334192:0:14152:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782217146.334201:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e67fd06800/0xf210a9075089fc97 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089fc9e expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217146.334208:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e67fd06800/0xf210a9075089fc97 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089fc9e expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217146.334218:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217146.334220:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217146.334222:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217146.334257:0:14147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782217146.334263:0:14147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6743a0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:713996b4-9a75-4cc4-875d-de8926ad5952+3:16184:x1868789734020864:12345-0@lo:104: Request processed in 106us (2775us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217146.334271:0:14147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782217146.334320:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00010000:00010000:3.0:1782217146.334321:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217146.334395:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.119@tcp lock: ffff88e67437aa00/0xf210a9075089fc4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf210a9075089fc51 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217146.334403:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437aa00 already unused, calling callback (ffffffffc1d2fc20) 10000000:00010000:3.0:1782217146.334406:0:14151:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.119@tcp lock: ffff88e67437aa00/0xf210a9075089fc4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf210a9075089fc51 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217146.334423:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00010000:00010000:3.0:1782217146.334425:0:14151:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.119@tcp lock: ffff88e67437aa00/0xf210a9075089fc4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf210a9075089fc51 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782217146.334434:0:14151:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.119@tcp lock: ffff88e67437aa00/0xf210a9075089fc4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf210a9075089fc51 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782217146.334440:0:14151:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1782217146.334457:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e649197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:713996b4-9a75-4cc4-875d-de8926ad5952:3303:1868789734020992:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782217146.334463:0:14151:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.119@tcp lock: ffff88e67437aa00/0xf210a9075089fc4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089fc51 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217146.334470:0:14151:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782217146.334488:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.119@tcp lock: ffff88e67437aa00/0xf210a9075089fc4a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089fc51 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217146.334497:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.119@tcp lock: ffff88e67437aa00/0xf210a9075089fc4a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf210a9075089fc51 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217146.334506:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782217146.334517:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217146.334520:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217146.334523:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217146.334535:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67420f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:713996b4-9a75-4cc4-875d-de8926ad5952:3301:1868789734021248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782217146.334555:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782217146.334566:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217146.334566:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e649195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:713996b4-9a75-4cc4-875d-de8926ad5952:3303:1868789734021120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782217146.334599:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217146.334629:0:14150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714107008 00000100:00100000:0.0:1782217146.334640:0:14150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714107008 00010000:00010000:0.0:1782217146.334665:0:14150:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88e6738afa00/0xf210a9075089ff30 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6206bf expref: 13 pid: 14157 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217146.334682:0:14150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714107136 00000100:00100000:0.0:1782217146.334685:0:14150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714107136 00010000:00010000:0.0:1782217146.334697:0:14150:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88e6738ae000/0xf210a9075089fef8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62065d expref: 14 pid: 14156 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217146.334706:0:14150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734020992 00000100:00100000:0.0:1782217146.334708:0:14150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734020992 00010000:00010000:0.0:1782217146.334718:0:14150:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88e682170400/0xf210a9075089fdd9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089fdd2 expref: 19 pid: 14156 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217146.334727:0:14150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734021248 00000100:00100000:0.0:1782217146.334729:0:14150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734021248 00010000:00010000:0.0:1782217146.334738:0:14150:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88e6738af800/0xf210a9075089fc51 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089fc4a expref: 20 pid: 14155 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217146.334747:0:14150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734021120 00000100:00100000:0.0:1782217146.334749:0:14150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734021120 00010000:00010000:0.0:1782217146.334760:0:14150:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88e682170800/0xf210a9075089fc9e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089fc97 expref: 21 pid: 14155 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217146.334772:0:14150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 4 00000100:00100000:0.0:1782217146.334779:0:14150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649195880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f0dd3e5-488b-4209-a0f7-377d359c4f44+14:2359:x1868789714107008:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217146.334791:0:14150:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217146.334797:0:14150:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88e6738afa00/0xf210a9075089ff30 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6206bf expref: 14 pid: 14157 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217146.334808:0:14150:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88e6738afa00/0xf210a9075089ff30 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6206bf expref: 14 pid: 14157 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217146.335032:0:16184:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6469ee0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782217146.335059:0:16184:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6508d8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16184:1868789734020352:192.168.203.19@tcp:104: 00000100:00100000:1.0:1782217146.335068:0:16184:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6508da300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16184:1868789734020480:192.168.203.19@tcp:104: 00000100:00100000:1.0:1782217146.335077:0:16184:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6508dbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16184:1868789734020608:0@lo:104: 00000100:00100000:1.0:1782217146.335088:0:16184:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6508d8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16184:1868789734020736:0@lo:104: 00000100:00100000:1.0:1782217146.335094:0:16184:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6508dad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16184:1868789734020864:0@lo:104: 00010000:00010000:1.0:1782217146.335387:0:16184:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88e5410b1200/0xf210a9075089ff5a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217146.335398:0:14150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e6738afa00/0xf210a9075089ff30 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6206bf expref: 14 pid: 14157 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217146.335437:0:14148:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1782217146.335446:0:14148:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1782217146.335574:0:14150:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782217146.335595:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217146.335637:0:14150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649195880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f0dd3e5-488b-4209-a0f7-377d359c4f44+13:2359:x1868789714107008:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 856us (1319us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217146.335649:0:14150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 4 00000100:00100000:0.0:1782217146.335675:0:14150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 5 00000100:00100000:0.0:1782217146.335684:0:14150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649195c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f0dd3e5-488b-4209-a0f7-377d359c4f44+12:2358:x1868789714107136:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217146.335696:0:14150:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217146.335702:0:14150:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88e6738ae000/0xf210a9075089fef8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62065d expref: 12 pid: 14156 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217146.335712:0:14150:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88e6738ae000/0xf210a9075089fef8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62065d expref: 12 pid: 14156 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217146.335724:0:14150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e6738ae000/0xf210a9075089fef8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62065d expref: 12 pid: 14156 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217146.335733:0:14150:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217146.335754:0:14150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649195c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f0dd3e5-488b-4209-a0f7-377d359c4f44+11:2358:x1868789714107136:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 72us (1333us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217146.335760:0:14150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 5 00000100:00100000:0.0:1782217146.335775:0:14150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782217146.335782:0:14150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e679f99050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:713996b4-9a75-4cc4-875d-de8926ad5952+21:3303:x1868789734020992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782217146.335792:0:14150:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217146.335806:0:14150:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88e682170400/0xf210a9075089fdd9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089fdd2 expref: 21 pid: 14156 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217146.335903:0:14150:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88e682170400/0xf210a9075089fdd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf210a9075089fdd2 expref: 21 pid: 14156 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217146.336028:0:14150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e682170400/0xf210a9075089fdd9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf210a9075089fdd2 expref: 21 pid: 14156 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217146.336040:0:14150:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217146.336091:0:14150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e679f99050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:713996b4-9a75-4cc4-875d-de8926ad5952+20:3303:x1868789734020992:12345-0@lo:103:ldlm_bl.0 Request processed in 310us (1588us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217146.336097:0:14150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782217146.336140:0:14150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782217146.336146:0:14150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67420d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:713996b4-9a75-4cc4-875d-de8926ad5952+19:3301:x1868789734021248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782217146.336153:0:14150:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217146.336158:0:14150:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88e6738af800/0xf210a9075089fc51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089fc4a expref: 19 pid: 14155 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217146.336235:0:14150:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88e6738af800/0xf210a9075089fc51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf210a9075089fc4a expref: 19 pid: 14155 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217146.336248:0:14150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e6738af800/0xf210a9075089fc51 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf210a9075089fc4a expref: 19 pid: 14155 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217146.336257:0:14150:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217146.336290:0:14150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67420d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:713996b4-9a75-4cc4-875d-de8926ad5952+18:3301:x1868789734021248:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (1725us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217146.336297:0:14150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782217146.336311:0:14150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782217146.336326:0:14150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649194000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:713996b4-9a75-4cc4-875d-de8926ad5952+17:3303:x1868789734021120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782217146.336334:0:14150:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217146.336338:0:14150:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88e682170800/0xf210a9075089fc9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf210a9075089fc97 expref: 17 pid: 14155 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217146.336347:0:14150:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88e682170800/0xf210a9075089fc9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf210a9075089fc97 expref: 17 pid: 14155 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217146.336370:0:14150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e682170800/0xf210a9075089fc9e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf210a9075089fc97 expref: 17 pid: 14155 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217146.336382:0:14150:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88e5410b1200/0xf210a9075089ff5a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217146.336392:0:14150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e5410b1200/0xf210a9075089ff5a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217146.336408:0:14150:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88e5410b1200/0xf210a9075089ff5a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217146.336415:0:14150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88e5410b1200/0xf210a9075089ff5a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217146.336421:0:14150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88e5410b1200/0xf210a9075089ff5a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217146.336428:0:14150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88e5410b1200/0xf210a9075089ff5a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217146.336434:0:14150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e5410b1200 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:0.0:1782217146.336439:0:14150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88e5410b1200/0xf210a9075089ff5a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217146.336455:0:14150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88e5410b1200/0xf210a9075089ff5a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217146.336468:0:14150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88e5410b1200/0xf210a9075089ff5a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217146.336480:0:14150:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217146.336506:0:14150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649194000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:713996b4-9a75-4cc4-875d-de8926ad5952+16:3303:x1868789734021120:12345-0@lo:103:ldlm_bl.0 Request processed in 181us (1906us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217146.336513:0:14150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782217146.336562:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67420f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:713996b4-9a75-4cc4-875d-de8926ad5952:3301:1868789734021248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782217146.336646:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e649195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:713996b4-9a75-4cc4-875d-de8926ad5952:3303:1868789734021120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782217146.336787:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e649197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:713996b4-9a75-4cc4-875d-de8926ad5952:3303:1868789734020992:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782217146.337057:0:16184:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88e5410b1200/0xf210a9075089ff5a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217146.337068:0:16184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88e5410b1200/0xf210a9075089ff5a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217146.337075:0:16184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88e5410b1200/0xf210a9075089ff5a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217146.900154:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782217147.733407:0:14160:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782217147.733415:0:14160:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff88e6751ec000 from 10 10000000:01000000:0.0:1782217147.733420:0:14160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782217147.733467:0:14160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67437a400/0xf210a9075089ff61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217147.733479:0:14160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e67437a400/0xf210a9075089ff61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217147.733490:0:14160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e67437a400/0xf210a9075089ff61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217147.733522:0:14160:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e649195880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:713996b4-9a75-4cc4-875d-de8926ad5952:14160:1868789734021376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782217147.733586:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217147.733631:0:14160:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6652e0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782217147.735492:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734021376 00000100:00100000:2.0:1782217147.735505:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734021376 00000100:00100000:2.0:1782217147.735558:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1782217147.735567:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6434db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+16:14160:x1868789734021376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782217147.735582:0:14157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217147.735599:0:14157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e6738ae000/0xf210a9075089ff68 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089ff61 expref: -99 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217147.735625:0:14157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e6738ae000/0xf210a9075089ff68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089ff61 expref: 17 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217147.735635:0:14157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e6738ae000/0xf210a9075089ff68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089ff61 expref: 17 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217147.735644:0:14157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738ae000, rc 0) 00000100:00100000:2.0:1782217147.735702:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6434db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+17:14160:x1868789734021376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (2115us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217147.735708:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1782217147.735796:0:14160:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e649195880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:713996b4-9a75-4cc4-875d-de8926ad5952:14160:1868789734021376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782217147.735813:0:14160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e67437a400/0xf210a9075089ff61 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ff68 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217147.735822:0:14160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e67437a400/0xf210a9075089ff61 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089ff68 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217147.735903:0:14160:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e649195880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:713996b4-9a75-4cc4-875d-de8926ad5952:14160:1868789734021504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782217147.735937:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217147.735974:0:14160:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6652e0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1782217147.736043:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734021504 00000100:00100000:3.0:1782217147.736048:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734021504 00000100:00100000:3.0:1782217147.736084:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1782217147.736108:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6434dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+17:14160:x1868789734021504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782217147.736410:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6434dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+17:14160:x1868789734021504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 304us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217147.736417:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1782217147.739070:0:14160:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e649195880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:713996b4-9a75-4cc4-875d-de8926ad5952:14160:1868789734021504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782217147.739128:0:14160:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e649195880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:713996b4-9a75-4cc4-875d-de8926ad5952:14160:1868789734021632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782217147.739202:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217147.739238:0:14160:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6652e0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782217147.742950:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734021632 00000100:00100000:2.0:1782217147.742966:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734021632 00000100:00100000:2.0:1782217147.743024:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1782217147.743043:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6434dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+17:14160:x1868789734021632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782217147.743285:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6434dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+17:14160:x1868789734021632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 244us (4083us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217147.743293:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1782217147.745477:0:14160:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e649195880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:713996b4-9a75-4cc4-875d-de8926ad5952:14160:1868789734021632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782217147.747791:0:16248:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1782217147.747938:0:14160:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1782217147.747959:0:14160:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782217147.747970:0:14160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67437a400/0xf210a9075089ff61 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ff68 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217147.747981:0:14160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e67437a400/0xf210a9075089ff61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ff68 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782217147.747990:0:14160:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782217147.747993:0:14160:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff88e643535000 from 10 10000000:01000000:3.0:1782217147.747995:0:14160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782217147.748030:0:14160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e675139e00/0xf210a9075089ff6f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217147.748038:0:14160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e675139e00/0xf210a9075089ff6f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217147.748049:0:14160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e675139e00/0xf210a9075089ff6f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217147.748072:0:14160:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67420f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:713996b4-9a75-4cc4-875d-de8926ad5952:14160:1868789734021760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782217147.748135:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217147.748176:0:14160:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e644494540 going to sleep for 11 seconds 00000100:00100000:2.0:1782217147.748378:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734021760 00000100:00100000:2.0:1782217147.748385:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734021760 00000100:00100000:2.0:1782217147.748435:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1782217147.748444:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6446d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+17:14160:x1868789734021760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782217147.748457:0:14155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217147.748469:0:14155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e6738af800/0xf210a9075089ff76 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089ff6f expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217147.748490:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e6738af800/0xf210a9075089ff76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089ff6f expref: 18 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217147.748500:0:14155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e6738af800/0xf210a9075089ff76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089ff6f expref: 18 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217147.748508:0:14155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738af800, rc 0) 00000100:00100000:2.0:1782217147.748553:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6446d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:713996b4-9a75-4cc4-875d-de8926ad5952+18:14160:x1868789734021760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217147.748560:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1782217147.749098:0:14160:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67420f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:713996b4-9a75-4cc4-875d-de8926ad5952:14160:1868789734021760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782217147.749116:0:14160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e675139e00/0xf210a9075089ff6f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ff76 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217147.749139:0:14160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e675139e00/0xf210a9075089ff6f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089ff76 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217147.749196:0:14160:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6508dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:713996b4-9a75-4cc4-875d-de8926ad5952:14160:1868789734021888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782217147.749230:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217147.749265:0:14160:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e650a4d240 going to sleep for 11 seconds 00000100:00100000:2.0:1782217147.749371:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734021888 00000100:00100000:2.0:1782217147.749377:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734021888 00000100:00100000:2.0:1782217147.749414:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1782217147.749422:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6446d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+18:14160:x1868789734021888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782217147.749665:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6446d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+18:14160:x1868789734021888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 243us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217147.749679:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1782217147.749683:0:14160:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6508dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:713996b4-9a75-4cc4-875d-de8926ad5952:14160:1868789734021888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782217147.749721:0:14160:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6508dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:713996b4-9a75-4cc4-875d-de8926ad5952:14160:1868789734022016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782217147.749763:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217147.749783:0:14160:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e650a4d240 going to sleep for 11 seconds 00000100:00100000:3.0:1782217147.749830:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734022016 00000100:00100000:3.0:1782217147.749835:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734022016 00000100:00100000:3.0:1782217147.749868:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1782217147.749901:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6446d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+18:14160:x1868789734022016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782217147.750052:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6446d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+18:14160:x1868789734022016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 176us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217147.750059:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1782217147.750193:0:14160:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6508dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:713996b4-9a75-4cc4-875d-de8926ad5952:14160:1868789734022016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782217147.757049:0:16249:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1782217147.757393:0:14160:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1782217147.757412:0:14160:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782217147.757423:0:14160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e675139e00/0xf210a9075089ff6f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ff76 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217147.757434:0:14160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e675139e00/0xf210a9075089ff6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ff76 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782217147.757468:0:14160:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782217147.757471:0:14160:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff88e652461000 from 10 10000000:01000000:0.0:1782217147.757473:0:14160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782217147.757509:0:14160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67437aa00/0xf210a9075089ff7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217147.757518:0:14160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.119@tcp lock: ffff88e67437aa00/0xf210a9075089ff7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217147.757529:0:14160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.119@tcp lock: ffff88e67437aa00/0xf210a9075089ff7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217147.757555:0:14160:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e649195c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:713996b4-9a75-4cc4-875d-de8926ad5952:14160:1868789734022144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782217147.757617:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217147.757662:0:14160:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64e380f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782217147.757859:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734022144 00000100:00100000:2.0:1782217147.757867:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734022144 00000100:00100000:2.0:1782217147.757928:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1782217147.757937:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6446d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+18:14160:x1868789734022144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782217147.757951:0:14157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217147.757963:0:14157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e6738af000/0xf210a9075089ff84 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf210a9075089ff7d expref: -99 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217147.757986:0:14157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e6738af000/0xf210a9075089ff84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf210a9075089ff7d expref: 19 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217147.757996:0:14157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e6738af000/0xf210a9075089ff84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf210a9075089ff7d expref: 19 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217147.758005:0:14157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738af000, rc 0) 00000100:00100000:2.0:1782217147.758051:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6446d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+19:14160:x1868789734022144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217147.758058:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1782217147.761597:0:14160:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e649195c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:713996b4-9a75-4cc4-875d-de8926ad5952:14160:1868789734022144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782217147.761628:0:14160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.119@tcp lock: ffff88e67437aa00/0xf210a9075089ff7d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ff84 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217147.761641:0:14160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.119@tcp lock: ffff88e67437aa00/0xf210a9075089ff7d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf210a9075089ff84 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217147.761723:0:14160:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6508dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:713996b4-9a75-4cc4-875d-de8926ad5952:14160:1868789734022272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782217147.761782:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217147.761828:0:14160:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64e0d39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782217147.762183:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734022272 00000100:00100000:2.0:1782217147.762191:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734022272 00000100:00100000:2.0:1782217147.762241:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1782217147.762250:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6446d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+19:14160:x1868789734022272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782217147.762531:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6446d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+19:14160:x1868789734022272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 280us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217147.762539:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1782217147.765327:0:14160:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6508dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:713996b4-9a75-4cc4-875d-de8926ad5952:14160:1868789734022272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782217147.765420:0:14160:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6508dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:713996b4-9a75-4cc4-875d-de8926ad5952:14160:1868789734022400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782217147.765487:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217147.765527:0:14160:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e64e0d39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782217147.765548:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734022400 00000100:00100000:1.0:1782217147.765554:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734022400 00000100:00100000:1.0:1782217147.765599:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1782217147.765607:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6446d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+19:14160:x1868789734022400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782217147.765791:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6446d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:713996b4-9a75-4cc4-875d-de8926ad5952+19:14160:x1868789734022400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 183us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217147.765798:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1782217147.765850:0:14160:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6508dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:713996b4-9a75-4cc4-875d-de8926ad5952:14160:1868789734022400:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782217147.766535:0:16251:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1782217147.766588:0:14160:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1782217147.766602:0:14160:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782217147.766611:0:14160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.119@tcp lock: ffff88e67437aa00/0xf210a9075089ff7d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ff84 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217147.766621:0:14160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.119@tcp lock: ffff88e67437aa00/0xf210a9075089ff7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf210a9075089ff84 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217147.929432:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217148.347462:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217148.352470:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714107264 00000100:00100000:2.0:1782217148.352490:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714107264 00000100:00100000:2.0:1782217148.352542:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 116 00000100:00100000:2.0:1782217148.352552:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6446d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f0dd3e5-488b-4209-a0f7-377d359c4f44+11:13734:x1868789714107264:12345-192.168.203.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782217148.352569:0:14156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217148.352586:0:14156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e6738afa00/0xf210a9075089ff8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6206f0 expref: -99 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217148.352613:0:14156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e6738afa00/0xf210a9075089ff8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6206f0 expref: 12 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217148.352625:0:14156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e6738afa00/0xf210a9075089ff8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6206f0 expref: 12 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217148.352635:0:14156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738afa00, rc 0) 00000100:00100000:2.0:1782217148.352694:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6446d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f0dd3e5-488b-4209-a0f7-377d359c4f44+12:13734:x1868789714107264:12345-192.168.203.19@tcp:101:ll_cfg_requeue.0 Request processed in 144us (5241us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217148.352702:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 116 00000100:00100000:0.0:1782217148.361420:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217148.362324:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714107392 00000100:00100000:1.0:1782217148.362344:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714107392 00000100:00100000:1.0:1782217148.362397:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 117 00000100:00100000:1.0:1782217148.362407:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6446d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f0dd3e5-488b-4209-a0f7-377d359c4f44+12:13734:x1868789714107392:12345-192.168.203.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782217148.362684:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6446d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f0dd3e5-488b-4209-a0f7-377d359c4f44+12:13734:x1868789714107392:12345-192.168.203.19@tcp:501:ll_cfg_requeue.0 Request processed in 277us (1272us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217148.362702:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 117 00000100:00100000:2.0:1782217148.368187:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217148.368316:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714107520 00000100:00100000:0.0:1782217148.368325:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714107520 00000100:00100000:0.0:1782217148.369738:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 118 00000100:00100000:0.0:1782217148.369753:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6446d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f0dd3e5-488b-4209-a0f7-377d359c4f44+12:13734:x1868789714107520:12345-192.168.203.19@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782217148.369982:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6446d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f0dd3e5-488b-4209-a0f7-377d359c4f44+12:13734:x1868789714107520:12345-192.168.203.19@tcp:503:ll_cfg_requeue.0 Request processed in 231us (1800us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217148.369990:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 118 00000100:00100000:1.0:1782217148.375717:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6508dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789734022528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782217148.375784:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217148.376426:0:14802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734022528 00000100:00100000:2.0:1782217148.376435:0:14802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734022528 00000100:00100000:2.0:1782217148.376494:0:14802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782217148.376503:0:14802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789734022528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782217148.376539:0:14802:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782217148.376590:0:14802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789734022528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217148.376598:0:14802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1782217148.376618:0:14158:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782217148.376654:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6508dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789734022528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782217148.379003:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:713996b4-9a75-4cc4-875d-de8926ad5952:3303:1868789734022656:0@lo:400:kworker.0 00000100:00100000:2.0:1782217148.379072:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217148.379109:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1868789734023168:0@lo:400:kworker.0 00000100:00100000:2.0:1782217148.379137:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217148.379160:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782217148.379166:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789734022784:0@lo:400:kworker.0 00000100:00100000:2.0:1782217148.379189:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217148.379221:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734022656 00000100:00100000:2.0:1782217148.379228:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734022656 00000100:00100000:2.0:1782217148.379266:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1782217148.379275:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6446d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+19:3303:x1868789734022656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217148.379322:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6446d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+19:3303:x1868789734022656:12345-0@lo:400:kworker.0 Request processed in 48us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217148.379329:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1782217148.379377:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734023168 00000100:00100000:2.0:1782217148.379382:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734023168 00000100:00100000:2.0:1782217148.379414:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782217148.379421:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1868789734023168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217148.379452:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1868789734023168:12345-0@lo:400:kworker.0 Request processed in 31us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217148.379457:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782217148.379474:0:14800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734022784 00000100:00100000:2.0:1782217148.379477:0:14800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734022784 00000100:00100000:2.0:1782217148.379502:0:14800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782217148.379508:0:14800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789734022784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217148.379535:0:14800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789734022784:12345-0@lo:400:kworker.0 Request processed in 28us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217148.379554:0:14800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782217148.379588:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789734022784:0@lo:400:kworker.0 00000100:00100000:2.0:1782217148.379599:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:713996b4-9a75-4cc4-875d-de8926ad5952:3303:1868789734022656:0@lo:400:kworker.0 00000100:00100000:2.0:1782217148.379610:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1868789734023168:0@lo:400:kworker.0 00000100:00080000:2.0:1782217148.379633:0:14158:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782217148.379637:0:14158:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782217148.379652:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1868789734023040:0@lo:400:kworker.0 00000100:00100000:2.0:1782217148.379683:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217148.379706:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782217148.379713:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1868789734022912:0@lo:400:kworker.0 00000100:00100000:2.0:1782217148.379736:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217148.379767:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734023040 00000100:00100000:2.0:1782217148.379771:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734023040 00000100:00100000:2.0:1782217148.379796:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734022912 00000100:00100000:2.0:1782217148.379799:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734022912 00000100:00100000:2.0:1782217148.379816:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782217148.379821:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1868789734023040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217148.379856:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1868789734023040:12345-0@lo:400:kworker.0 Request processed in 34us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217148.379861:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782217148.379872:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782217148.379894:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1868789734022912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217148.379922:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1868789734022912:12345-0@lo:400:kworker.0 Request processed in 45us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217148.379928:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1782217148.379975:0:14158:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782217148.380222:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1868789734022912:0@lo:400:kworker.0 00000100:00100000:2.0:1782217148.380232:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1868789734023040:0@lo:400:kworker.0 00000100:00100000:1.0:1782217148.386718:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217148.387085:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714107648 00000100:00100000:2.0:1782217148.387095:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714107648 00000100:00100000:2.0:1782217148.387144:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 120 00000100:00100000:2.0:1782217148.387154:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6446d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f0dd3e5-488b-4209-a0f7-377d359c4f44+12:13734:x1868789714107648:12345-192.168.203.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782217148.387171:0:14156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217148.387190:0:14156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88e6738aee00/0xf210a9075089ff92 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6206f7 expref: -99 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217148.387218:0:14156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88e6738aee00/0xf210a9075089ff92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6206f7 expref: 13 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217148.387229:0:14156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88e6738aee00/0xf210a9075089ff92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6206f7 expref: 13 pid: 14156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217148.387238:0:14156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e6738aee00, rc 0) 00000100:00100000:2.0:1782217148.387286:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6446d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f0dd3e5-488b-4209-a0f7-377d359c4f44+13:13734:x1868789714107648:12345-192.168.203.19@tcp:101:ll_cfg_requeue.0 Request processed in 133us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217148.387293:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 120 00000100:00100000:2.0:1782217148.394469:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217148.394619:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714107776 00000100:00100000:1.0:1782217148.394630:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714107776 00000100:00100000:1.0:1782217148.394718:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 121 00000100:00100000:1.0:1782217148.394729:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6446d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f0dd3e5-488b-4209-a0f7-377d359c4f44+13:13734:x1868789714107776:12345-192.168.203.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782217148.395064:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6446d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f0dd3e5-488b-4209-a0f7-377d359c4f44+13:13734:x1868789714107776:12345-192.168.203.19@tcp:501:ll_cfg_requeue.0 Request processed in 335us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217148.395072:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 121 00000100:00100000:0.0:1782217148.410309:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217148.414614:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714107904 00000100:00100000:1.0:1782217148.414628:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714107904 00000100:00100000:1.0:1782217148.414697:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 122 00000100:00100000:1.0:1782217148.414709:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6446d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f0dd3e5-488b-4209-a0f7-377d359c4f44+13:13734:x1868789714107904:12345-192.168.203.19@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782217148.414948:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6446d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f0dd3e5-488b-4209-a0f7-377d359c4f44+13:13734:x1868789714107904:12345-192.168.203.19@tcp:503:ll_cfg_requeue.0 Request processed in 241us (4646us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217148.414957:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 122 00010000:00010000:3.0:1782217148.948132:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217149.972037:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217150.073481:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217150.075609:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714108032 00000100:00100000:2.0:1782217150.075624:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714108032 00000100:00100000:2.0:1782217150.075714:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 15 00000100:00100000:2.0:1782217150.075726:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+6:14389:x1868789714108032:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782217150.075746:0:14163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217150.075781:0:14163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae600/0xf210a9075089ff99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6206fe expref: -99 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.075849:0:14163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160c00/0xf210a9075089ffa0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.075863:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160c00/0xf210a9075089ffa0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.075873:0:14163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160c00/0xf210a9075089ffa0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.075928:0:14163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161e00/0xf210a9075089ffa7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.075936:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161e00/0xf210a9075089ffa7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.075943:0:14163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161e00/0xf210a9075089ffa7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1782217150.075977:0:14158:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782217150.076385:0:14163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161400/0xf210a9075089ffae lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.076522:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161400/0xf210a9075089ffae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.076532:0:14163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161400/0xf210a9075089ffae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217150.076622:0:14163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1782217150.076627:0:14163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1782217150.076727:0:14163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161400/0xf210a9075089ffae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.076744:0:14163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160c00/0xf210a9075089ffa0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.076750:0:14163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160c00/0xf210a9075089ffa0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.076757:0:14163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160c00/0xf210a9075089ffa0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.076763:0:14163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e653160c00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217150.076767:0:14163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160c00/0xf210a9075089ffa0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.076775:0:14163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160c00/0xf210a9075089ffa0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.076787:0:14163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e65417f600) 00010000:00010000:2.0:1782217150.076791:0:14163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217150.076795:0:14163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160c00/0xf210a9075089ffa0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.076801:0:14163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160c00/0xf210a9075089ffa0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.076813:0:14163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161e00/0xf210a9075089ffa7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.076819:0:14163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161e00/0xf210a9075089ffa7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.076825:0:14163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161e00/0xf210a9075089ffa7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.076836:0:14163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e653161e00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217150.076840:0:14163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161e00/0xf210a9075089ffa7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.076846:0:14163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161e00/0xf210a9075089ffa7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.076854:0:14163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff88e65417f500) 00010000:00010000:2.0:1782217150.076856:0:14163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217150.076859:0:14163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161e00/0xf210a9075089ffa7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.076864:0:14163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161e00/0xf210a9075089ffa7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.077024:0:14163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738ae600/0xf210a9075089ff99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6206fe expref: 8 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.077040:0:14163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161400/0xf210a9075089ffae lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6206fe expref: 7 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.077047:0:14163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88e65417fb00) 00010000:00010000:2.0:1782217150.077049:0:14163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782217150.077052:0:14163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e653161400, rc 0) 00000100:00100000:2.0:1782217150.077123:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+7:14389:x1868789714108032:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 1400us (3663us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217150.077131:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 15 00000100:00100000:1.0:1782217150.084986:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217150.085144:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714108288 00000100:00100000:2.0:1782217150.085167:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714108288 00000100:00100000:2.0:1782217150.085218:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 16 00000100:00100000:2.0:1782217150.085227:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+7:14389:x1868789714108288:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782217150.085249:0:14164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217150.085268:0:14164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160c00/0xf210a9075089ffb5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620705 expref: -99 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.085364:0:14164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a9075089ffbc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.085379:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a9075089ffbc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.085390:0:14164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a9075089ffbc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.085460:0:14164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160000/0xf210a9075089ffc3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.085468:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160000/0xf210a9075089ffc3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.085475:0:14164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160000/0xf210a9075089ffc3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.086237:0:14164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161a00/0xf210a9075089ffca lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.086251:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161a00/0xf210a9075089ffca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.086258:0:14164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161a00/0xf210a9075089ffca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217150.086273:0:14164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1782217150.087354:0:14164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a9075089ffbc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.087369:0:14164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a9075089ffbc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.087375:0:14164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a9075089ffbc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.087381:0:14164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e653161000 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217150.087385:0:14164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a9075089ffbc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.087392:0:14164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a9075089ffbc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.088024:0:14164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88e65417fb00) 00010000:00010000:2.0:1782217150.088028:0:14164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217150.088033:0:14164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a9075089ffbc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.088040:0:14164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a9075089ffbc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.088055:0:14164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160000/0xf210a9075089ffc3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.088060:0:14164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160000/0xf210a9075089ffc3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.088079:0:14164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160000/0xf210a9075089ffc3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.088084:0:14164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e653160000 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217150.088088:0:14164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160000/0xf210a9075089ffc3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.088094:0:14164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160000/0xf210a9075089ffc3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.088103:0:14164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff88e65417f100) 00010000:00010000:2.0:1782217150.088105:0:14164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217150.088108:0:14164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160000/0xf210a9075089ffc3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.088114:0:14164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160000/0xf210a9075089ffc3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.089949:0:14164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160c00/0xf210a9075089ffb5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620705 expref: 10 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.089974:0:14164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161a00/0xf210a9075089ffca lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620705 expref: 9 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.089982:0:14164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88e65417f400) 00010000:00010000:2.0:1782217150.089985:0:14164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217150.089988:0:14164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e653161a00, rc 0) 00000100:00100000:2.0:1782217150.090050:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+9:14389:x1868789714108288:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 4823us (5072us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1782217150.090068:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 16 00000100:00100000:3.0:1782217150.103027:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217150.103437:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714108416 00000100:00100000:2.0:1782217150.103447:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714108416 00000100:00100000:2.0:1782217150.103546:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 17 00000100:00100000:2.0:1782217150.103557:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67420dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+9:14389:x1868789714108416:12345-192.168.203.19@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1782217150.103668:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67420dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+9:14389:x1868789714108416:12345-192.168.203.19@tcp:59:lhsmtool_posix.0 Request processed in 112us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217150.103676:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 17 00000100:00100000:0.0:1782217150.155316:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217150.158842:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714108544 00000100:00100000:2.0:1782217150.158858:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714108544 00000100:00100000:2.0:1782217150.158974:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 18 00000100:00100000:2.0:1782217150.158984:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+9:14395:x1868789714108544:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:2.0:1782217150.159002:0:14162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217150.159022:0:14162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160c00/0xf210a9075089ffd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62070c expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.159084:0:14162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160000/0xf210a9075089ffdf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.159103:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160000/0xf210a9075089ffdf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.159114:0:14162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160000/0xf210a9075089ffdf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.159128:0:14162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a9075089ffe6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.159152:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a9075089ffe6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.159160:0:14162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a9075089ffe6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.159419:0:14162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160000/0xf210a9075089ffdf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.159428:0:14162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160000/0xf210a9075089ffdf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.159434:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160000/0xf210a9075089ffdf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.159440:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e653160000 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217150.159444:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160000/0xf210a9075089ffdf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.159451:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160000/0xf210a9075089ffdf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.159462:0:14162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e65417f600) 00010000:00010000:2.0:1782217150.159465:0:14162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217150.159469:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160000/0xf210a9075089ffdf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.159475:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160000/0xf210a9075089ffdf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.159487:0:14162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a9075089ffe6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.159498:0:14162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a9075089ffe6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.159504:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a9075089ffe6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.159509:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e653161000 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217150.159512:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a9075089ffe6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.159519:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a9075089ffe6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.159527:0:14162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff88e65417f100) 00010000:00010000:2.0:1782217150.159530:0:14162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217150.159532:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a9075089ffe6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.159538:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a9075089ffe6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.159570:0:14162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160c00/0xf210a9075089ffd8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62070c expref: 10 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.159580:0:14162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e65417f600) 00010000:00010000:2.0:1782217150.159583:0:14162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217150.159587:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160c00/0xf210a9075089ffd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62070c expref: 10 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.159606:0:14162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e653160c00, rc 0) 00000100:00100000:2.0:1782217150.159674:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+9:14395:x1868789714108544:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 691us (4367us total) trans 0 rc 301/301 00000100:00100000:2.0:1782217150.159682:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 18 00000100:00100000:3.0:1782217150.174443:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217150.175031:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714108672 00000100:00100000:0.0:1782217150.175042:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714108672 00000100:00100000:0.0:1782217150.175110:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 0 00000100:00100000:0.0:1782217150.175121:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67420f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+9:14395:x1868789714108672:12345-192.168.203.19@tcp:700:lfs.0 00000100:00100000:0.0:1782217150.175206:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67420f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+9:14395:x1868789714108672:12345-192.168.203.19@tcp:700:lfs.0 Request processed in 86us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217150.175214:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 0 00000100:00100000:0.0:1782217150.180361:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217150.180426:0:15334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714108928 00000100:00100000:1.0:1782217150.180436:0:15334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714108928 00000100:00100000:1.0:1782217150.180494:0:15334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 19 00000100:00100000:1.0:1782217150.180504:0:15334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+9:14395:x1868789714108928:12345-192.168.203.19@tcp:36:lfs.0 00010000:00010000:1.0:1782217150.180557:0:15334:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217150.180685:0:15334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e6738af400/0xf210a9075089ff1b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620687 expref: 9 pid: 15334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217150.180705:0:15334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e65417f600) 00010000:00010000:1.0:1782217150.180711:0:15334:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782217150.181083:0:15334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e5410b0000/0xf210a9075089ffed lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217150.181099:0:15334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139400/0xf210a9075089ff53 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6206e9 expref: 5 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217150.181109:0:15334:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e5410b0000/0xf210a9075089ffed lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217150.181141:0:15334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139400/0xf210a9075089ff53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6206e9 expref: 5 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217150.181155:0:15334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139400/0xf210a9075089ff53 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6206e9 expref: 5 pid: 14162 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217150.181168:0:15334:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6508da300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15334:1868789734023296:192.168.203.19@tcp:104: 00000100:00100000:1.0:1782217150.181353:0:15334:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e644494540 going to sleep for 11 seconds 00000100:00100000:1.0:1782217150.187551:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217150.188015:0:15334:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6508da300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15334:1868789734023296:192.168.203.19@tcp:104: 00010000:00010000:2.0:1782217150.188046:0:15334:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88e5410b0000/0xf210a9075089ffed lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217150.189429:0:14150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714109056 00000100:00100000:0.0:1782217150.189440:0:14150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714109056 00010000:00010000:0.0:1782217150.189550:0:14150:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139400/0xf210a9075089ff53 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6206e9 expref: 6 pid: 14162 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217150.189603:0:14150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 9 00000100:00100000:0.0:1782217150.189614:0:14150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+6:2359:x1868789714109056:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217150.189629:0:14150:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217150.189636:0:14150:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139400/0xf210a9075089ff53 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6206e9 expref: 6 pid: 14162 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217150.189648:0:14150:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139400/0xf210a9075089ff53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6206e9 expref: 6 pid: 14162 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217150.189672:0:14150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139400/0xf210a9075089ff53 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6206e9 expref: 6 pid: 14162 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217150.189706:0:14150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e65417f600) 00010000:00010000:0.0:1782217150.189712:0:14150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88e5410b0000/0xf210a9075089ffed lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217150.189721:0:14150:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e5410b0000/0xf210a9075089ffed lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217150.189728:0:14150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e5410b0000/0xf210a9075089ffed lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217150.189762:0:14150:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217150.189814:0:14150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+5:2359:x1868789714109056:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 201us (2271us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217150.189822:0:14150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 9 00010000:00010000:2.0:1782217150.190380:0:15334:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88e5410b0000/0xf210a9075089ffed lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.190390:0:15334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e5410b0000/0xf210a9075089ffed lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.190414:0:15334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a9075089fff4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.190423:0:15334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a9075089fff4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.190432:0:15334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a9075089fff4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1782217150.193732:0:14158:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1782217150.193990:0:15334:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1782217150.194008:0:15334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e5410b0000/0xf210a9075089ffed lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.194018:0:15334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e5410b0000/0xf210a9075089ffed lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.194039:0:15334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e5410b0000/0xf210a9075089ffed lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.194044:0:15334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e5410b0000 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217150.194048:0:15334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e5410b0000/0xf210a9075089ffed lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.194055:0:15334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e5410b0000/0xf210a9075089ffed lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.194071:0:15334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e65417f600) 00010000:00010000:2.0:1782217150.194074:0:15334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217150.194078:0:15334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e5410b0000/0xf210a9075089ffed lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.194085:0:15334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e5410b0000/0xf210a9075089ffed lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782217150.194264:0:15334:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000095a4573e reply state 000000008d8436b5 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a9075089fff4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217150.194274:0:15334:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782217150.194458:0:15334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+10:14395:x1868789714108928:12345-192.168.203.19@tcp:36:lfs.0 Request processed in 13951us (14103us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1782217150.194467:0:15334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 19 00010000:00010000:2.0:1782217150.199164:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a9075089fff4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.199181:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a9075089fff4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.199204:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a9075089fff4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.199211:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e653161000 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217150.199283:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a9075089fff4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.199293:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a9075089fff4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.199312:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff88e65417f100) 00010000:00010000:2.0:1782217150.199316:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217150.199329:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a9075089fff4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.199336:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a9075089fff4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217150.250413:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217150.250540:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714109184 00000100:00100000:2.0:1782217150.250556:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714109184 00000100:00100000:2.0:1782217150.250633:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 20 00000100:00100000:2.0:1782217150.250644:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+9:14403:x1868789714109184:12345-192.168.203.19@tcp:101:lctl.0 00010000:00010000:2.0:1782217150.250669:0:14162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217150.250693:0:14162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a9075089fffb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620713 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.250770:0:14162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160000/0xf210a907508a0002 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.250802:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160000/0xf210a907508a0002 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.250820:0:14162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160000/0xf210a907508a0002 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217150.250907:0:14162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782217150.250912:0:14162:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1782217150.250958:0:14162:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160000/0xf210a907508a0002 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.250984:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a9075089fffb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620713 expref: 11 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.251004:0:14162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160000/0xf210a907508a0002 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620713 expref: 10 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.251012:0:14162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e65417f100) 00010000:00010000:2.0:1782217150.251016:0:14162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782217150.251019:0:14162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e653160000, rc 0) 00000100:00100000:2.0:1782217150.251086:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+10:14403:x1868789714109184:12345-192.168.203.19@tcp:101:lctl.0 Request processed in 443us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217150.251093:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 20 00000100:00100000:1.0:1782217150.278549:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217150.278676:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714109312 00000100:00100000:2.0:1782217150.278688:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714109312 00000100:00100000:2.0:1782217150.278776:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 21 00000100:00100000:2.0:1782217150.278787:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+5:14404:x1868789714109312:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:2.0:1782217150.278813:0:14163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217150.278853:0:14163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a907508a0009 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62071a expref: -99 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.279001:0:14163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161e00/0xf210a907508a0010 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.279018:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161e00/0xf210a907508a0010 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.279032:0:14163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161e00/0xf210a907508a0010 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217150.279105:0:14163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782217150.279109:0:14163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1782217150.279135:0:14163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161e00/0xf210a907508a0010 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.279179:0:14163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a907508a0009 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62071a expref: 7 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.279202:0:14163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161e00/0xf210a907508a0010 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62071a expref: 6 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.279212:0:14163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e65417f100) 00010000:00010000:2.0:1782217150.279216:0:14163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782217150.279221:0:14163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e653161e00, rc 0) 00000100:00100000:3.0:1782217150.280811:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+6:14404:x1868789714109312:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 2010us (2260us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217150.280836:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 21 00000100:00100000:2.0:1782217150.286185:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217150.286270:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714109440 00000100:00100000:0.0:1782217150.286282:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714109440 00000100:00100000:0.0:1782217150.286372:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 22 00000100:00100000:0.0:1782217150.286383:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+6:14404:x1868789714109440:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:0.0:1782217150.286410:0:14162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217150.286435:0:14162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a907508a0017 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620721 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217150.286517:0:14162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b600/0xf210a907508a001e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217150.286534:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b600/0xf210a907508a001e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217150.286570:0:14162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b600/0xf210a907508a001e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217150.286589:0:14162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a907508a0025 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217150.286597:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a907508a0025 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217150.286604:0:14162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a907508a0025 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217150.287752:0:14162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a907508a002c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217150.287776:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a907508a002c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217150.287788:0:14162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a907508a002c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217150.287962:0:14162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1782217150.287970:0:14162:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782217150.288009:0:14162:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a907508a002c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217150.288030:0:14162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b600/0xf210a907508a001e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217150.288058:0:14162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b600/0xf210a907508a001e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217150.288068:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b600/0xf210a907508a001e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217150.288075:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437b600 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217150.288081:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b600/0xf210a907508a001e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217150.288092:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b600/0xf210a907508a001e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217150.288112:0:14162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e65417f100) 00010000:00010000:1.0:1782217150.288116:0:14162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217150.288121:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b600/0xf210a907508a001e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217150.288128:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b600/0xf210a907508a001e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217150.288149:0:14162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a907508a0025 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217150.288156:0:14162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a907508a0025 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217150.288163:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a907508a0025 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217150.288168:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437bc00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:1.0:1782217150.288179:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a907508a0025 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217150.288186:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a907508a0025 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217150.288194:0:14162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff88e647d05900) 00010000:00010000:1.0:1782217150.288197:0:14162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217150.288200:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a907508a0025 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217150.288207:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437bc00/0xf210a907508a0025 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217150.288254:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a000/0xf210a907508a0017 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620721 expref: 8 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217150.288271:0:14162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a907508a002c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620721 expref: 7 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217150.288278:0:14162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88e647d05600) 00010000:00010000:1.0:1782217150.288280:0:14162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782217150.288283:0:14162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437b800, rc 0) 00000100:00100000:1.0:1782217150.288400:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+7:14404:x1868789714109440:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 2017us (2227us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217150.288409:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 22 00000040:00080000:1.0:1782217150.295128:0:14196:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1782217150.296794:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217150.296905:0:15334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714109696 00000100:00100000:1.0:1782217150.296930:0:15334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714109696 00000100:00100000:1.0:1782217150.297019:0:15334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 23 00000100:00100000:1.0:1782217150.297051:0:15334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+7:14404:x1868789714109696:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:1.0:1782217150.297079:0:15334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217150.297106:0:15334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e5410b1a00/0xf210a907508a0033 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620728 expref: -99 pid: 15334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217150.297266:0:15334:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1782217150.297435:0:15334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e5410b1a00/0xf210a907508a0033 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620728 expref: 9 pid: 15334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217150.297453:0:15334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e65417f100) 00010000:00010000:1.0:1782217150.297457:0:15334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782217150.297463:0:15334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e5410b1a00/0xf210a907508a0033 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620728 expref: 9 pid: 15334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217150.297478:0:15334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e5410b1a00, rc 0) 00000100:00100000:1.0:1782217150.297854:0:15334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+8:14404:x1868789714109696:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 804us (1066us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1782217150.297863:0:15334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 23 00000100:00100000:0.0:1782217150.301013:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217150.301131:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714109952 00000100:00100000:1.0:1782217150.301144:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714109952 00000100:00100000:1.0:1782217150.301225:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 24 00000100:00100000:1.0:1782217150.301236:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+8:14404:x1868789714109952:12345-192.168.203.19@tcp:36:lfs.0 00010000:00010000:1.0:1782217150.301310:0:14164:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217150.301359:0:14164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b800/0xf210a907508a002c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620721 expref: 8 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217150.301390:0:14164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88e647d05600) 00010000:00010000:1.0:1782217150.301422:0:14164:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782217150.301455:0:14164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e5410b1000/0xf210a907508a0041 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217150.301470:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e5410b1000/0xf210a907508a0041 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217150.301481:0:14164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e5410b1000/0xf210a907508a0041 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782217150.301769:0:14164:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000803d6525 reply state 000000002ab01dce transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff88e5410b1000/0xf210a907508a0041 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217150.301781:0:14164:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1782217150.301796:0:14164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:1.0:1782217150.301949:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+9:14404:x1868789714109952:12345-192.168.203.19@tcp:36:lfs.0 Request processed in 713us (950us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1782217150.301957:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 24 00010000:00010000:3.0:1782217150.304690:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88e5410b1000/0xf210a907508a0041 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.304712:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e5410b1000/0xf210a907508a0041 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.304720:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e5410b1000/0xf210a907508a0041 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.304727:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e5410b1000 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217150.304733:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e5410b1000/0xf210a907508a0041 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.304742:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e5410b1000/0xf210a907508a0041 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.304763:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88e6468fd300) 00010000:00010000:3.0:1782217150.304767:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1782217150.304789:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e5410b1000/0xf210a907508a0041 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.304796:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e5410b1000/0xf210a907508a0041 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217150.305229:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217150.305295:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714110208 00000100:00100000:3.0:1782217150.305306:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714110208 00000100:00100000:3.0:1782217150.305370:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 2 00000100:00100000:3.0:1782217150.305382:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+8:14404:x1868789714110208:12345-192.168.203.19@tcp:35:lfs.0 00000100:00100000:3.0:1782217150.305795:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+9:14404:x1868789714110208:12345-192.168.203.19@tcp:35:lfs.0 Request processed in 412us (570us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1782217150.305804:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 2 00000100:00100000:2.0:1782217150.308342:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217150.308484:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714110464 00000100:00100000:3.0:1782217150.308497:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714110464 00000100:00100000:3.0:1782217150.308578:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 25 00000100:00100000:3.0:1782217150.308590:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+9:14404:x1868789714110464:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:3.0:1782217150.308620:0:14163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217150.308644:0:14163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139200/0xf210a907508a0048 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62072f expref: -99 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.308736:0:14163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138200/0xf210a907508a004f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.308752:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138200/0xf210a907508a004f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.308765:0:14163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138200/0xf210a907508a004f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.308801:0:14163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138a00/0xf210a907508a0056 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.308810:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138a00/0xf210a907508a0056 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.308817:0:14163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138a00/0xf210a907508a0056 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217150.309616:0:14163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1782217150.309744:0:14163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138200/0xf210a907508a004f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.309755:0:14163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138200/0xf210a907508a004f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.309762:0:14163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138200/0xf210a907508a004f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.309769:0:14163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e675138200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217150.309775:0:14163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138200/0xf210a907508a004f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.309784:0:14163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138200/0xf210a907508a004f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.309799:0:14163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e65417f100) 00010000:00010000:3.0:1782217150.309803:0:14163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217150.309808:0:14163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138200/0xf210a907508a004f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.309830:0:14163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138200/0xf210a907508a004f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.309848:0:14163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138a00/0xf210a907508a0056 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.309855:0:14163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138a00/0xf210a907508a0056 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.309861:0:14163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138a00/0xf210a907508a0056 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.309867:0:14163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e675138a00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217150.309870:0:14163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138a00/0xf210a907508a0056 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.309906:0:14163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138a00/0xf210a907508a0056 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.310024:0:14163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff88e660936c00) 00010000:00010000:3.0:1782217150.310027:0:14163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217150.310033:0:14163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138a00/0xf210a907508a0056 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.310039:0:14163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138a00/0xf210a907508a0056 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.310094:0:14163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139200/0xf210a907508a0048 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62072f expref: 11 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.310117:0:14163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e65417f100) 00010000:00010000:3.0:1782217150.310119:0:14163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782217150.310123:0:14163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139200/0xf210a907508a0048 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62072f expref: 11 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.310133:0:14163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e675139200, rc 0) 00000100:00100000:3.0:1782217150.310253:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+10:14404:x1868789714110464:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 1664us (1938us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1782217150.310262:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 25 00000100:00100000:1.0:1782217150.317115:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217150.317271:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714110592 00000100:00100000:0.0:1782217150.317284:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714110592 00000100:00100000:0.0:1782217150.317371:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 26 00000100:00100000:0.0:1782217150.317384:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+10:14404:x1868789714110592:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:0.0:1782217150.317420:0:14164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217150.317451:0:14164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a907508a0064 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620736 expref: -99 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217150.317597:0:14164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a200/0xf210a907508a006b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217150.317613:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a200/0xf210a907508a006b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217150.317626:0:14164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a200/0xf210a907508a006b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217150.317692:0:14164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1782217150.317696:0:14164:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782217150.317728:0:14164:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a200/0xf210a907508a006b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217150.317763:0:14164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a907508a0064 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620736 expref: 12 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217150.317781:0:14164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a200/0xf210a907508a006b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620736 expref: 11 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217150.317790:0:14164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88e647d05500) 00010000:00010000:0.0:1782217150.317793:0:14164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782217150.317796:0:14164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437a200, rc 0) 00000100:00100000:0.0:1782217150.317939:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+11:14404:x1868789714110592:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 496us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217150.317947:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 26 00000100:00100000:1.0:1782217150.326120:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217150.327545:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714110720 00000100:00100000:3.0:1782217150.327561:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714110720 00000100:00100000:3.0:1782217150.327645:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 3 00000100:00100000:3.0:1782217150.327657:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+11:14404:x1868789714110720:12345-192.168.203.19@tcp:37:lfs.0 00000100:00100000:0.0:1782217150.335016:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+11:14404:x1868789714110720:12345-192.168.203.19@tcp:37:lfs.0 Request processed in 7345us (8895us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217150.335058:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 3 00000100:00100000:1.0:1782217150.341475:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217150.344596:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714110976 00000100:00100000:2.0:1782217150.344616:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714110976 00000100:00100000:2.0:1782217150.344699:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 4 00000100:00100000:2.0:1782217150.344730:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f2cd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+11:14404:x1868789714110976:12345-192.168.203.19@tcp:35:lfs.0 00000100:00100000:2.0:1782217150.346651:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f2cd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+12:14404:x1868789714110976:12345-192.168.203.19@tcp:35:lfs.0 Request processed in 1909us (5175us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1782217150.346672:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 4 00000100:00100000:1.0:1782217150.408695:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217150.408939:0:15334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714111104 00000100:00100000:2.0:1782217150.408952:0:15334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714111104 00000100:00100000:2.0:1782217150.409079:0:15334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 27 00000100:00100000:2.0:1782217150.409091:0:15334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+10:14410:x1868789714111104:12345-192.168.203.19@tcp:101:bash.0 00010000:00010000:2.0:1782217150.409119:0:15334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217150.409148:0:15334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a907508a0072 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62073d expref: -99 pid: 15334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.409230:0:15334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a907508a0079 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.409246:0:15334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a907508a0079 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.409259:0:15334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a907508a0079 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.409274:0:15334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a907508a0080 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.409280:0:15334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a907508a0080 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.409287:0:15334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a907508a0080 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.409553:0:15334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a907508a0087 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.409564:0:15334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a907508a0087 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.409572:0:15334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a907508a0087 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217150.409621:0:15334:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1782217150.409625:0:15334:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782217150.409674:0:15334:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a907508a0087 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.409687:0:15334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a907508a0079 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.409694:0:15334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a907508a0079 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.409701:0:15334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a907508a0079 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.409708:0:15334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e653160400 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217150.409713:0:15334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a907508a0079 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.409721:0:15334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a907508a0079 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.409735:0:15334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e65417f100) 00010000:00010000:2.0:1782217150.409745:0:15334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217150.409751:0:15334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a907508a0079 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.409758:0:15334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a907508a0079 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.409775:0:15334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a907508a0080 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.409781:0:15334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a907508a0080 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.409788:0:15334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a907508a0080 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.409794:0:15334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e653161200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217150.409797:0:15334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a907508a0080 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.409804:0:15334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a907508a0080 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.409829:0:15334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff88e65417f600) 00010000:00010000:2.0:1782217150.409832:0:15334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217150.409835:0:15334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a907508a0080 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.409841:0:15334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a907508a0080 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.409943:0:15334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a907508a0072 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62073d expref: 12 pid: 15334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.409971:0:15334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161c00/0xf210a907508a0087 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62073d expref: 11 pid: 15334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.409978:0:15334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88e647d05500) 00010000:00010000:2.0:1782217150.409981:0:15334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1782217150.409983:0:15334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e653161c00, rc 0) 00000100:00100000:2.0:1782217150.410055:0:15334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+11:14410:x1868789714111104:12345-192.168.203.19@tcp:101:bash.0 Request processed in 966us (1374us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217150.410065:0:15334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 27 00000100:00100000:0.0:1782217150.414391:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217150.414833:0:15334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714111360 00000100:00100000:2.0:1782217150.414846:0:15334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714111360 00000100:00100000:2.0:1782217150.414947:0:15334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 28 00000100:00100000:2.0:1782217150.414959:0:15334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+11:14410:x1868789714111360:12345-192.168.203.19@tcp:101:bash.0 00010000:00010000:2.0:1782217150.414987:0:15334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217150.415014:0:15334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a907508a008e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620744 expref: -99 pid: 15334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.415190:0:15334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a907508a0095 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.415208:0:15334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a200/0xf210a907508a006b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620736 expref: 11 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.415219:0:15334:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a907508a0095 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.415266:0:15334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a200/0xf210a907508a006b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620736 expref: 11 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.415337:0:15334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a200/0xf210a907508a006b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620736 expref: 11 pid: 14164 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217150.415353:0:15334:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e64e2a0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15334:1868789734023424:192.168.203.19@tcp:104: 00000100:00100000:2.0:1782217150.415478:0:15334:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6447649c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782217150.419533:0:15334:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e64e2a0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15334:1868789734023424:192.168.203.19@tcp:104: 00010000:00010000:2.0:1782217150.419576:0:15334:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a907508a0095 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217150.420452:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217150.420602:0:14148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714111488 00000100:00100000:2.0:1782217150.420613:0:14148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714111488 00010000:00010000:2.0:1782217150.420674:0:14148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a200/0xf210a907508a006b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620736 expref: 12 pid: 14164 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217150.420724:0:14148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 10 00000100:00100000:2.0:1782217150.420736:0:14148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649194700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+12:2359:x1868789714111488:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217150.420753:0:14148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217150.420761:0:14148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a200/0xf210a907508a006b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620736 expref: 12 pid: 14164 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.420775:0:14148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a200/0xf210a907508a006b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620736 expref: 12 pid: 14164 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.420802:0:14148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a200/0xf210a907508a006b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620736 expref: 12 pid: 14164 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.420856:0:14148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88e647d05500) 00010000:00010000:2.0:1782217150.420862:0:14148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a907508a0095 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.420874:0:14148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a907508a0095 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.420903:0:14148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a907508a0095 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.420933:0:14148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217150.420999:0:14148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649194700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+11:2359:x1868789714111488:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 265us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217150.421008:0:14148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 10 00010000:00010000:3.0:1782217150.422194:0:15334:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a907508a0095 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.422211:0:15334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a907508a0095 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.422250:0:15334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139200/0xf210a907508a009c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.422265:0:15334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139200/0xf210a907508a009c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.422277:0:15334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139200/0xf210a907508a009c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.426428:0:15334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138a00/0xf210a907508a00a3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.426455:0:15334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138a00/0xf210a907508a00a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.426469:0:15334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138a00/0xf210a907508a00a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217150.426485:0:15334:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1782217150.427042:0:15334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a907508a0095 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.427055:0:15334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a907508a0095 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.427062:0:15334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a907508a0095 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.427069:0:15334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e653161000 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217150.427075:0:15334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a907508a0095 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.427083:0:15334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a907508a0095 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.427099:0:15334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88e647d05500) 00010000:00010000:3.0:1782217150.427102:0:15334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217150.427107:0:15334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a907508a0095 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.427132:0:15334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161000/0xf210a907508a0095 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782217150.427152:0:15334:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009c77b7f9 reply state 00000000d6874a30 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139200/0xf210a907508a009c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217150.427163:0:15334:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782217150.427216:0:15334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a907508a008e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620744 expref: 14 pid: 15334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.427234:0:15334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138a00/0xf210a907508a00a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620744 expref: 13 pid: 15334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.427243:0:15334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88e660936800) 00010000:00010000:3.0:1782217150.427246:0:15334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1782217150.427248:0:15334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e675138a00, rc 0) 00000100:00100000:3.0:1782217150.427479:0:15334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+14:14410:x1868789714111360:12345-192.168.203.19@tcp:101:bash.0 Request processed in 12521us (13115us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1782217150.427491:0:15334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 28 00000100:00100000:2.0:1782217150.441724:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217150.441809:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714111616 00010000:00010000:3.0:1782217150.441820:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139200/0xf210a907508a009c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217150.441822:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714111616 00010000:00010000:3.0:1782217150.441836:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139200/0xf210a907508a009c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.441844:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139200/0xf210a907508a009c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.441851:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e675139200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217150.441900:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139200/0xf210a907508a009c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217150.441909:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 29 00010000:00010000:3.0:1782217150.441913:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139200/0xf210a907508a009c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217150.441924:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+14:14410:x1868789714111616:12345-192.168.203.19@tcp:101:bash.0 00010000:00010000:3.0:1782217150.441937:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff88e660936c00) 00010000:00010000:3.0:1782217150.441942:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217150.441948:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139200/0xf210a907508a009c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.441955:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139200/0xf210a907508a009c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.441956:0:14163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217150.441980:0:14163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a907508a00b1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62074b expref: -99 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.442068:0:14163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a907508a00b8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.442083:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a907508a00b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.442106:0:14163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a907508a00b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217150.442157:0:14163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1782217150.442163:0:14163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782217150.442183:0:14163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a907508a00b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.442195:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a907508a00b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.442219:0:14163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a907508a00b1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62074b expref: 15 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.442234:0:14163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a907508a00b8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62074b expref: 14 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.442241:0:14163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88e660936800) 00010000:00010000:2.0:1782217150.442243:0:14163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782217150.442246:0:14163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e653160400, rc 0) 00000100:00100000:2.0:1782217150.442330:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+14:14410:x1868789714111616:12345-192.168.203.19@tcp:101:bash.0 Request processed in 399us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217150.442339:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 29 00000100:00100000:2.0:1782217150.456160:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217150.456265:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714111872 00000100:00100000:0.0:1782217150.456278:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714111872 00000100:00100000:0.0:1782217150.456362:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 5 00000100:00100000:0.0:1782217150.456375:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+14:14410:x1868789714111872:12345-192.168.203.19@tcp:35:bash.0 00000100:00100000:0.0:1782217150.456859:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+15:14410:x1868789714111872:12345-192.168.203.19@tcp:35:bash.0 Request processed in 485us (712us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1782217150.456869:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 5 00000100:00100000:0.0:1782217150.463095:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217150.463140:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217150.463184:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217150.463218:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217150.463242:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217150.463274:0:15336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714112128 00000100:00100000:0.0:1782217150.463287:0:15336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714112128 00000100:00100000:0.0:1782217150.463363:0:15336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714112384 00000100:00100000:0.0:1782217150.463366:0:15336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714112384 00000100:00100000:0.0:1782217150.463381:0:15336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714112256 00000100:00100000:0.0:1782217150.463383:0:15336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714112256 00000100:00100000:0.0:1782217150.463395:0:15336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714112512 00000100:00100000:0.0:1782217150.463397:0:15336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714112512 00000100:00100000:0.0:1782217150.463415:0:15336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 10 00000100:00100000:0.0:1782217150.463426:0:15336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+5:2359:x1868789714112128:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:0.0:1782217150.463527:0:15336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+5:2359:x1868789714112128:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 101us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217150.463557:0:15336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 10 00000100:00100000:0.0:1782217150.463577:0:15336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 11 00000100:00100000:0.0:1782217150.463583:0:15336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+5:2359:x1868789714112384:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:0.0:1782217150.463609:0:15336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+5:2359:x1868789714112384:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 26us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217150.463616:0:15336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 11 00000100:00100000:0.0:1782217150.463637:0:15336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 12 00000100:00100000:0.0:1782217150.463643:0:15336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+5:2359:x1868789714112256:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:0.0:1782217150.463666:0:15336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+5:2359:x1868789714112256:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 23us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217150.463672:0:15336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 12 00000100:00100000:3.0:1782217150.463732:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714112000 00000100:00100000:3.0:1782217150.463738:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714112000 00000100:00100000:3.0:1782217150.463773:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 123 00000100:00100000:3.0:1782217150.463780:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6446d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f0dd3e5-488b-4209-a0f7-377d359c4f44+13:2359:x1868789714112000:12345-192.168.203.19@tcp:400:kworker.0 00000100:00100000:3.0:1782217150.463811:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6446d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f0dd3e5-488b-4209-a0f7-377d359c4f44+13:2359:x1868789714112000:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 31us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217150.463829:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 123 00000100:00100000:0.0:1782217150.463860:0:15336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 13 00000100:00100000:0.0:1782217150.463873:0:15336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+5:2359:x1868789714112512:12345-192.168.203.19@tcp:400:kworker.0 00000100:00080000:1.0:1782217150.463956:0:14158:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782217150.463961:0:14158:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782217150.464216:0:15336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cd6d5c1-d0c9-4508-b714-88d0ed7acc3b+5:2359:x1868789714112512:12345-192.168.203.19@tcp:400:kworker.0 Request processed in 345us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217150.475859:0:15336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 13 00000100:00100000:1.0:1782217150.565229:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217150.565365:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714112768 00000100:00100000:0.0:1782217150.565379:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714112768 00000100:00100000:0.0:1782217150.565461:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 30 00000100:00100000:0.0:1782217150.565472:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+15:14420:x1868789714112768:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:0.0:1782217150.565512:0:14164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217150.565539:0:14164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a907508a00bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620752 expref: -99 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217150.565836:0:14164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1782217150.566044:0:14164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a907508a00bf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620752 expref: 17 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217150.566063:0:14164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88e65417f100) 00010000:00010000:0.0:1782217150.566067:0:14164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782217150.566074:0:14164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a907508a00bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620752 expref: 17 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217150.566093:0:14164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437ac00, rc 0) 00000100:00100000:0.0:1782217150.566162:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+16:14420:x1868789714112768:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 692us (947us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1782217150.566169:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 30 00000100:00100000:1.0:1782217150.572345:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217150.572437:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714113024 00000100:00100000:0.0:1782217150.572449:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714113024 00000100:00100000:0.0:1782217150.572526:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 6 00000100:00100000:0.0:1782217150.572537:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+16:14420:x1868789714113024:12345-192.168.203.19@tcp:35:lfs.0 00000100:00100000:0.0:1782217150.572924:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+17:14420:x1868789714113024:12345-192.168.203.19@tcp:35:lfs.0 Request processed in 387us (592us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1782217150.572935:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 6 00000100:00100000:1.0:1782217150.609746:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217150.610132:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714113280 00000100:00100000:3.0:1782217150.610145:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714113280 00000100:00100000:3.0:1782217150.610228:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 31 00000100:00100000:3.0:1782217150.610240:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+17:14423:x1868789714113280:12345-192.168.203.19@tcp:101:lfs.0 00010000:00010000:3.0:1782217150.610273:0:14162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217150.610299:0:14162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138200/0xf210a907508a00cd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620759 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.610463:0:14162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139200/0xf210a907508a00d4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.610480:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139200/0xf210a907508a00d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.610493:0:14162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139200/0xf210a907508a00d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217150.610514:0:14162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1782217150.610685:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138200/0xf210a907508a00cd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620759 expref: 20 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.610709:0:14162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139200/0xf210a907508a00d4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620759 expref: 19 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.610718:0:14162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88e660936800) 00010000:00010000:3.0:1782217150.610722:0:14162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782217150.610726:0:14162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e675139200, rc 0) 00000100:00100000:3.0:1782217150.610810:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+19:14423:x1868789714113280:12345-192.168.203.19@tcp:101:lfs.0 Request processed in 572us (1079us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1782217150.610830:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 31 00000100:00100000:1.0:1782217150.615925:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217150.615971:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217150.616130:0:14150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714113536 00000100:00100000:0.0:1782217150.616143:0:14150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714113536 00000100:00100000:0.0:1782217150.616233:0:14150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 0 00000100:00100000:0.0:1782217150.616247:0:14150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+19:2356:x1868789714113536:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217150.616272:0:14150:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217150.616345:0:14150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139200/0xf210a907508a00d4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620759 expref: 19 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217150.616370:0:14150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88e660936800) 00010000:00010000:0.0:1782217150.616377:0:14150:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217150.616474:0:14150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+18:2356:x1868789714113536:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 231us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217150.616483:0:14150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 0 00000100:00100000:3.0:1782217150.617456:0:15334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714113408 00000100:00100000:3.0:1782217150.617469:0:15334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714113408 00000100:00100000:3.0:1782217150.617536:0:15334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 32 00000100:00100000:3.0:1782217150.617547:0:15334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+18:14423:x1868789714113408:12345-192.168.203.19@tcp:54:lfs.0 00010000:00010000:3.0:1782217150.617627:0:15334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138200/0xf210a907508a00e2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.617665:0:15334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138200/0xf210a907508a00e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.617679:0:15334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138200/0xf210a907508a00e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.617716:0:15334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138200/0xf210a907508a00e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.617725:0:15334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138200/0xf210a907508a00e2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.617732:0:15334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138200/0xf210a907508a00e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.617739:0:15334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e675138200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217150.617744:0:15334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138200/0xf210a907508a00e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.617753:0:15334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138200/0xf210a907508a00e2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.617767:0:15334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88e660936800) 00010000:00010000:3.0:1782217150.617771:0:15334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782217150.617776:0:15334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138200/0xf210a907508a00e2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.617783:0:15334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138200/0xf210a907508a00e2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217150.618055:0:15334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+18:14423:x1868789714113408:12345-192.168.203.19@tcp:54:lfs.0 Request processed in 508us (2177us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217150.618071:0:15334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 32 00000100:00100000:1.0:1782217150.622796:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217150.623201:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714113792 00000100:00100000:0.0:1782217150.623215:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714113792 00000100:00100000:0.0:1782217150.623314:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 7 00000100:00100000:0.0:1782217150.623334:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+18:14423:x1868789714113792:12345-192.168.203.19@tcp:35:lfs.0 00000100:00100000:0.0:1782217150.623671:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+19:14423:x1868789714113792:12345-192.168.203.19@tcp:35:lfs.0 Request processed in 338us (890us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1782217150.623682:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 7 00000100:00100000:2.0:1782217150.898450:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217150.898605:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714114048 00000100:00100000:3.0:1782217150.898619:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714114048 00000100:00100000:3.0:1782217150.898693:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 33 00000100:00100000:3.0:1782217150.898704:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+19:14454:x1868789714114048:12345-192.168.203.19@tcp:101:cat.0 00010000:00010000:3.0:1782217150.898742:0:14162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217150.898768:0:14162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138200/0xf210a907508a00e9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620760 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.899091:0:14162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138800/0xf210a907508a00f0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.899109:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138800/0xf210a907508a00f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.899123:0:14162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138800/0xf210a907508a00f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217150.899136:0:14162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1782217150.900655:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138200/0xf210a907508a00e9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620760 expref: 22 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.900689:0:14162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138800/0xf210a907508a00f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620760 expref: 21 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.900700:0:14162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88e660936800) 00010000:00010000:3.0:1782217150.900704:0:14162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782217150.900709:0:14162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e675138800, rc 0) 00000100:00100000:3.0:1782217150.900934:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+21:14454:x1868789714114048:12345-192.168.203.19@tcp:101:cat.0 Request processed in 2229us (2499us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1782217150.900945:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 33 00000100:00100000:2.0:1782217150.909256:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217150.910471:0:14148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714114176 00000100:00100000:3.0:1782217150.910488:0:14148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714114176 00000100:00100000:2.0:1782217150.910646:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217150.910871:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714114432 00000100:00100000:3.0:1782217150.910892:0:14148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 1 00000100:00100000:0.0:1782217150.910897:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714114432 00000100:00100000:0.0:1782217150.910943:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 8 00000100:00100000:0.0:1782217150.910955:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+22:14454:x1868789714114432:12345-192.168.203.19@tcp:35:cat.0 00000100:00100000:3.0:1782217150.911010:0:14148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e64e2a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+22:2359:x1868789714114176:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217150.911025:0:14148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217150.911054:0:14148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138800/0xf210a907508a00f0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620760 expref: 22 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.911076:0:14148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88e660936800) 00010000:00010000:3.0:1782217150.911082:0:14148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217150.911188:0:14148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+21:2359:x1868789714114176:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 180us (1946us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217150.911196:0:14148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 1 00000100:00100000:0.0:1782217150.911470:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e64e2a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+21:14454:x1868789714114432:12345-192.168.203.19@tcp:35:cat.0 Request processed in 517us (827us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1782217150.911479:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 8 00000100:00100000:1.0:1782217150.938836:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782217150.938870:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789734023552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782217150.938998:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217150.939373:0:14803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734023552 00000100:00100000:2.0:1782217150.939400:0:14803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734023552 00000100:00100000:2.0:1782217150.939478:0:14803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782217150.939489:0:14803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789734023552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782217150.939543:0:14803:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782217150.939599:0:14803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789734023552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217150.939607:0:14803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782217150.939784:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789734023552:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782217150.939812:0:14158:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782217150.983017:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217150.984049:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714114688 00000100:00100000:0.0:1782217150.984064:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714114688 00000100:00100000:0.0:1782217150.984210:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 34 00000100:00100000:0.0:1782217150.984222:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+21:14460:x1868789714114688:12345-192.168.203.19@tcp:101:dd.0 00010000:00010000:0.0:1782217150.984278:0:14164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217150.984306:0:14164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a907508a00fe lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620767 expref: -99 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217150.984457:0:14164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a200/0xf210a907508a0105 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217150.984471:0:14164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138a00/0xf210a907508a00a3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620744 expref: 22 pid: 15334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217150.984477:0:14164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a907508a00b8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62074b expref: 22 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217150.984483:0:14164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a200/0xf210a907508a0105 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217150.984528:0:14164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a907508a00b8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62074b expref: 22 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217150.984539:0:14164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a907508a00b8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62074b expref: 22 pid: 14163 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217150.984551:0:14164:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e649197b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14164:1868789734023680:192.168.203.19@tcp:104: 00010000:00010000:0.0:1782217150.984674:0:14164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138a00/0xf210a907508a00a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620744 expref: 22 pid: 15334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217150.984683:0:14164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138a00/0xf210a907508a00a3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620744 expref: 22 pid: 15334 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217150.984705:0:14164:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e649195f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14164:1868789734023808:192.168.203.19@tcp:104: 00000100:00100000:0.0:1782217150.984741:0:14164:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e652c806c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782217150.994956:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217150.995539:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217150.995643:0:14164:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e649197b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14164:1868789734023680:192.168.203.19@tcp:104: 00000100:00100000:0.0:1782217150.995658:0:14164:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e649195f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14164:1868789734023808:192.168.203.19@tcp:104: 00010000:00010000:0.0:1782217150.995688:0:14164:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a200/0xf210a907508a0105 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217150.996047:0:14150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714114816 00000100:00100000:3.0:1782217150.996124:0:14150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714114816 00010000:00010000:3.0:1782217150.996172:0:14150:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a907508a00b8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62074b expref: 23 pid: 14163 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217150.996247:0:14150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714114944 00000100:00100000:3.0:1782217150.996251:0:14150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714114944 00010000:00010000:3.0:1782217150.996267:0:14150:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138a00/0xf210a907508a00a3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620744 expref: 24 pid: 15334 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217150.996372:0:14148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 11 00000100:00100000:2.0:1782217150.996386:0:14148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e679f9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+24:2358:x1868789714114816:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217150.996417:0:14148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217150.996426:0:14148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a907508a00b8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62074b expref: 24 pid: 14163 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.996439:0:14148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a907508a00b8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62074b expref: 24 pid: 14163 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.996597:0:14148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160400/0xf210a907508a00b8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62074b expref: 24 pid: 14163 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.996620:0:14148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88e660936800) 00010000:00010000:2.0:1782217150.996626:0:14148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a200/0xf210a907508a0105 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.996636:0:14148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a200/0xf210a907508a0105 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.996662:0:14148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217150.996787:0:14148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e679f9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+23:2358:x1868789714114816:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 403us (1844us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217150.996795:0:14148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 11 00000100:00100000:1.0:1782217150.996855:0:14149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 12 00000100:00100000:1.0:1782217150.996868:0:14149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a816d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+22:2359:x1868789714114944:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782217150.996968:0:14149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217150.996977:0:14149:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138a00/0xf210a907508a00a3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620744 expref: 22 pid: 15334 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217150.996989:0:14149:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138a00/0xf210a907508a00a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620744 expref: 22 pid: 15334 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217150.997004:0:14149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138a00/0xf210a907508a00a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620744 expref: 22 pid: 15334 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217150.997016:0:14149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88e660936800) 00010000:00010000:1.0:1782217150.997020:0:14149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a200/0xf210a907508a0105 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217150.997030:0:14149:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a200/0xf210a907508a0105 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217150.997039:0:14149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a200/0xf210a907508a0105 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217150.997116:0:14149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782217150.997151:0:14149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a816d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+21:2359:x1868789714114944:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 286us (1614us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217150.997159:0:14149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 12 00010000:00010000:2.0:1782217150.997199:0:14164:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a200/0xf210a907508a0105 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.997208:0:14164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a200/0xf210a907508a0105 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217150.997233:0:14164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1782217150.997460:0:14164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a907508a00fe lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620767 expref: 22 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.997479:0:14164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a200/0xf210a907508a0105 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620767 expref: 21 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.997487:0:14164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88e660936800) 00010000:00010000:2.0:1782217150.997490:0:14164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782217150.997492:0:14164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437a200, rc 0) 00000100:00100000:2.0:1782217150.997537:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+21:14460:x1868789714114688:12345-192.168.203.19@tcp:101:dd.0 Request processed in 13316us (14535us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1782217150.997545:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 34 00010000:00010000:2.0:1782217151.000601:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782217151.002115:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217151.002260:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714115200 00000100:00100000:3.0:1782217151.002273:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714115200 00000100:00100000:3.0:1782217151.002376:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 35 00000100:00100000:3.0:1782217151.002388:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+21:14460:x1868789714115200:12345-192.168.203.19@tcp:36:dd.0 00010000:00010000:3.0:1782217151.002760:0:14163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138800/0xf210a907508a0113 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.002782:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138800/0xf210a907508a0113 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.002795:0:14163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138800/0xf210a907508a0113 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782217151.003022:0:14163:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1782217151.003053:0:14163:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001a6a0227 reply state 00000000bb7fc492 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138800/0xf210a907508a0113 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217151.003134:0:14163:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782217151.003304:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+24:14460:x1868789714115200:12345-192.168.203.19@tcp:36:dd.0 Request processed in 916us (1199us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1782217151.003322:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 35 00000020:00080000:3.0:1782217151.003329:0:14163:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782217151.005385:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138800/0xf210a907508a0113 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.005423:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138800/0xf210a907508a0113 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.005432:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138800/0xf210a907508a0113 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.005439:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e675138800 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217151.005445:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138800/0xf210a907508a0113 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.005477:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138800/0xf210a907508a0113 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.005497:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88e660936800) 00010000:00010000:3.0:1782217151.005500:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217151.005506:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138800/0xf210a907508a0113 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.005511:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138800/0xf210a907508a0113 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217151.005764:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217151.006085:0:15334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714115328 00000100:00100000:3.0:1782217151.006097:0:15334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714115328 00000100:00100000:3.0:1782217151.006173:0:15334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 36 00000100:00100000:3.0:1782217151.006185:0:15334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+23:14460:x1868789714115328:12345-192.168.203.19@tcp:101:dd.0 00010000:00010000:3.0:1782217151.006226:0:15334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217151.006248:0:15334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138200/0xf210a907508a011a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62076e expref: -99 pid: 15334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.006335:0:15334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138200/0xf210a907508a011a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62076e expref: 24 pid: 15334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.006352:0:15334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138200/0xf210a907508a011a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62076e expref: 24 pid: 15334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.006376:0:15334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88e660936800) 00010000:00010000:3.0:1782217151.006380:0:15334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782217151.006383:0:15334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e675138200, rc 0) 00000100:00100000:3.0:1782217151.006573:0:15334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+24:14460:x1868789714115328:12345-192.168.203.19@tcp:101:dd.0 Request processed in 389us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217151.006581:0:15334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 36 00000100:00100000:0.0:1782217151.019548:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217151.023122:0:14148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714115584 00000100:00100000:2.0:1782217151.023165:0:14148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714115584 00000100:00100000:2.0:1782217151.023345:0:14148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 2 00000100:00100000:2.0:1782217151.023358:0:14148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649195f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+24:14460:x1868789714115584:12345-192.168.203.19@tcp:103:dd.0 00010000:00010000:2.0:1782217151.023380:0:14148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217151.023426:0:14148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138200/0xf210a907508a011a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62076e expref: 24 pid: 15334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217151.023451:0:14148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88e660936800) 00010000:00010000:2.0:1782217151.023458:0:14148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217151.023551:0:14148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649195f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+23:14460:x1868789714115584:12345-192.168.203.19@tcp:103:dd.0 Request processed in 196us (4018us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217151.023571:0:14148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 2 00000100:00100000:0.0:1782217151.031632:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217151.033114:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714115712 00000100:00100000:3.0:1782217151.033186:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714115712 00000100:00100000:3.0:1782217151.033330:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 37 00000100:00100000:3.0:1782217151.033344:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+23:14460:x1868789714115712:12345-192.168.203.19@tcp:58:dd.0 00010000:00010000:3.0:1782217151.033494:0:14163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138800/0xf210a907508a0121 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.033516:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138800/0xf210a907508a0121 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.033532:0:14163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138800/0xf210a907508a0121 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782217151.034494:0:14163:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782217151.035227:0:14163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1782217151.035340:0:14163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1782217151.035734:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+23:14460:x1868789714115712:12345-192.168.203.19@tcp:58:dd.0 Request processed in 2385us (4109us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217151.035749:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 37 00000100:00100000:3.0:1782217151.042875:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217151.043221:0:15334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714115840 00000100:00100000:2.0:1782217151.043235:0:15334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714115840 00000100:00100000:2.0:1782217151.043305:0:15334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 38 00000100:00100000:2.0:1782217151.043328:0:15334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67420f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+23:14460:x1868789714115840:12345-192.168.203.19@tcp:101:dd.0 00010000:00010000:2.0:1782217151.043356:0:15334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217151.043385:0:15334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160c00/0xf210a907508a0128 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620775 expref: -99 pid: 15334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217151.043869:0:15334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138800/0xf210a907508a0121 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217151.043917:0:15334:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160c00/0xf210a907508a0128 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620775 expref: 24 pid: 15334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217151.043945:0:15334:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138800/0xf210a907508a0121 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217151.043986:0:15334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160c00/0xf210a907508a0128 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620775 expref: 24 pid: 15334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217151.044004:0:15334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88e660936800) 00010000:00010000:2.0:1782217151.044007:0:15334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782217151.044012:0:15334:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160c00/0xf210a907508a0128 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620775 expref: 24 pid: 15334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217151.044021:0:15334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e653160c00, rc 0) 00000100:00100000:2.0:1782217151.044115:0:15334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67420f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+24:14460:x1868789714115840:12345-192.168.203.19@tcp:101:dd.0 Request processed in 796us (1252us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217151.044123:0:15334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 38 00000040:00080000:1.0:1782217151.316327:0:14196:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1782217151.316343:0:14196:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782217151.316396:0:14196:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1782217151.316405:0:14196:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1782217151.318001:0:14196:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e6508d8700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14196:1868789734023936:192.168.203.19@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1782217151.318174:0:14196:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6444940c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782217151.321396:0:14196:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e6508d8700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14196:1868789734023936:192.168.203.19@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1782217151.325582:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217151.325844:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714115968 00000100:00100000:2.0:1782217151.325857:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714115968 00000100:00100000:2.0:1782217151.325963:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 0 00000100:00100000:2.0:1782217151.325976:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+24:14461:x1868789714115968:12345-192.168.203.19@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1782217151.326104:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+24:14461:x1868789714115968:12345-192.168.203.19@tcp:900:lhsmtool_posix.0 Request processed in 130us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217151.326113:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 0 00000100:00100000:3.0:1782217151.330230:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217151.330432:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714116096 00000100:00100000:0.0:1782217151.330445:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714116096 00000100:00100000:0.0:1782217151.330541:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 39 00000100:00100000:0.0:1782217151.330553:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67420ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+24:14461:x1868789714116096:12345-192.168.203.19@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782217151.330598:0:14162:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782217151.330752:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67420ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+24:14461:x1868789714116096:12345-192.168.203.19@tcp:53:lhsmtool_posix.0 Request processed in 200us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217151.331165:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 39 00000100:00100000:0.0:1782217151.336832:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217151.337043:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714116224 00000100:00100000:2.0:1782217151.337056:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714116224 00000100:00100000:2.0:1782217151.337123:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 40 00000100:00100000:2.0:1782217151.337136:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+24:14461:x1868789714116224:12345-192.168.203.19@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1782217151.337232:0:14164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a907508a012f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217151.337271:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a907508a012f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217151.337284:0:14164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a907508a012f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217151.337543:0:14164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a907508a0136 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217151.337565:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a907508a0136 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217151.337577:0:14164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a907508a0136 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217151.337610:0:14164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a907508a013d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217151.337618:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a907508a013d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217151.337624:0:14164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a907508a013d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217151.337665:0:14164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1782217151.337669:0:14164:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782217151.337680:0:14164:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a907508a013d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217151.337690:0:14164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a907508a012f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217151.337712:0:14164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a907508a012f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217151.337718:0:14164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a907508a012f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217151.337723:0:14164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e653160e00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217151.337727:0:14164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a907508a012f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217151.337734:0:14164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a907508a012f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217151.337746:0:14164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88e65417f400) 00010000:00010000:2.0:1782217151.337749:0:14164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217151.337753:0:14164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a907508a012f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217151.337758:0:14164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160e00/0xf210a907508a012f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217151.337774:0:14164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a907508a0136 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217151.337779:0:14164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a907508a0136 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217151.337784:0:14164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a907508a0136 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217151.337788:0:14164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e653161200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217151.337799:0:14164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a907508a0136 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217151.337805:0:14164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a907508a0136 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217151.337813:0:14164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff88e65417f600) 00010000:00010000:2.0:1782217151.337815:0:14164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217151.337818:0:14164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a907508a0136 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217151.337823:0:14164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a907508a0136 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217151.337839:0:14164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a907508a013d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217151.337846:0:14164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a907508a013d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217151.337851:0:14164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a907508a013d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217151.337855:0:14164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e653161600 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:2.0:1782217151.337857:0:14164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a907508a013d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217151.337862:0:14164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a907508a013d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217151.337868:0:14164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88e660936800) 00010000:00010000:2.0:1782217151.337870:0:14164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217151.337946:0:14164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a907508a013d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217151.337953:0:14164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161600/0xf210a907508a013d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217151.338044:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+24:14461:x1868789714116224:12345-192.168.203.19@tcp:34:lhsmtool_posix.0 Request processed in 906us (1230us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217151.338055:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 40 00000100:00100000:2.0:1782217151.351197:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217151.352395:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714116480 00000100:00100000:0.0:1782217151.352412:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714116480 00000100:00100000:0.0:1782217151.352509:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 41 00000100:00100000:0.0:1782217151.352522:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+24:14461:x1868789714116480:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782217151.352551:0:14162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217151.352600:0:14162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b600/0xf210a907508a0144 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62077c expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.353046:0:14162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a907508a014b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.353064:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a907508a014b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.353077:0:14162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a907508a014b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217151.353090:0:14162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1782217151.353218:0:14162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a907508a014b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.353227:0:14162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a907508a014b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.353235:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a907508a014b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.353241:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437ba00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217151.353246:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a907508a014b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.353255:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a907508a014b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.353269:0:14162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88e660936800) 00010000:00010000:0.0:1782217151.353272:0:14162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782217151.353278:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a907508a014b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.353296:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a907508a014b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.353366:0:14162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b600/0xf210a907508a0144 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62077c expref: 26 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.353378:0:14162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88e65417f400) 00010000:00010000:0.0:1782217151.353380:0:14162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782217151.353385:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b600/0xf210a907508a0144 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62077c expref: 26 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.353395:0:14162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437b600, rc 0) 00000100:00100000:0.0:1782217151.353485:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+25:14461:x1868789714116480:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 966us (2303us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1782217151.353503:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 41 00000100:00100000:1.0:1782217151.361466:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217151.361598:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714116608 00000100:00100000:2.0:1782217151.361611:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714116608 00000100:00100000:2.0:1782217151.361682:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 42 00000100:00100000:2.0:1782217151.361694:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+25:14461:x1868789714116608:12345-192.168.203.19@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1782217151.361743:0:14164:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1782217151.363121:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+25:14461:x1868789714116608:12345-192.168.203.19@tcp:53:lhsmtool_posix.0 Request processed in 1416us (1658us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217151.363136:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 42 00000100:00100000:2.0:1782217151.368159:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217151.368675:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714116864 00000100:00100000:3.0:1782217151.368689:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714116864 00000100:00100000:3.0:1782217151.368771:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 43 00000100:00100000:3.0:1782217151.368782:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+25:14461:x1868789714116864:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782217151.368806:0:14163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217151.368856:0:14163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139800/0xf210a907508a0159 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620783 expref: -99 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782217151.370272:0:14163:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:3.0:1782217151.370353:0:14163:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:3.0:1782217151.370413:0:14163:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:3.0:1782217151.372064:0:14163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139c00/0xf210a907508a0160 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.372086:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139c00/0xf210a907508a0160 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.372107:0:14163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139c00/0xf210a907508a0160 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.372194:0:14163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139800/0xf210a907508a0159 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620783 expref: 28 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.372217:0:14163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139c00/0xf210a907508a0160 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620783 expref: 27 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.372228:0:14163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88e660936c00) 00010000:00010000:3.0:1782217151.372231:0:14163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782217151.372236:0:14163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e675139c00, rc 0) 00000100:00100000:3.0:1782217151.372339:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+27:14461:x1868789714116864:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 3557us (4197us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1782217151.372349:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 43 00000100:00100000:0.0:1782217151.377128:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217151.377196:0:15334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714117120 00000100:00100000:3.0:1782217151.377210:0:15334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714117120 00000100:00100000:3.0:1782217151.377278:0:15334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 44 00000100:00100000:3.0:1782217151.377322:0:15334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+27:14461:x1868789714117120:12345-192.168.203.19@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782217151.377397:0:15334:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217151.377428:0:15334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139c00/0xf210a907508a0160 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620783 expref: 27 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.377449:0:15334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88e660936c00) 00010000:00010000:3.0:1782217151.377460:0:15334:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782217151.377485:0:15334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139a00/0xf210a907508a016e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.377509:0:15334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139a00/0xf210a907508a016e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.377519:0:15334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139a00/0xf210a907508a016e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.377535:0:15334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138000/0xf210a907508a0175 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf3c3af84 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.377543:0:15334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138000/0xf210a907508a0175 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf3c3af84 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.377549:0:15334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138000/0xf210a907508a0175 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf3c3af84 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.377640:0:15334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139a00/0xf210a907508a016e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.377647:0:15334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139a00/0xf210a907508a016e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.378207:0:15334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139a00/0xf210a907508a016e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.378213:0:15334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e675139a00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217151.378219:0:15334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139a00/0xf210a907508a016e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.378228:0:15334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139a00/0xf210a907508a016e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.378240:0:15334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88e647d05500) 00010000:00010000:3.0:1782217151.378243:0:15334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217151.378247:0:15334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139a00/0xf210a907508a016e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.378253:0:15334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139a00/0xf210a907508a016e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.378266:0:15334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138000/0xf210a907508a0175 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf3c3af84 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.378273:0:15334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138000/0xf210a907508a0175 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf3c3af84 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.378280:0:15334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138000/0xf210a907508a0175 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf3c3af84 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.378284:0:15334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e675138000 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217151.378287:0:15334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138000/0xf210a907508a0175 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf3c3af84 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.378301:0:15334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138000/0xf210a907508a0175 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf3c3af84 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.378308:0:15334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xf3c3af84 (ffff88e660936200) 00010000:00010000:3.0:1782217151.378311:0:15334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217151.378323:0:15334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138000/0xf210a907508a0175 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf3c3af84 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.378329:0:15334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138000/0xf210a907508a0175 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf3c3af84 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217151.378434:0:15334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+26:14461:x1868789714117120:12345-192.168.203.19@tcp:36:lhsmtool_posix.0 Request processed in 1119us (1318us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782217151.378442:0:15334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 44 00000100:00100000:1.0:1782217151.383616:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217151.383917:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714117248 00000100:00100000:0.0:1782217151.383931:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714117248 00000100:00100000:0.0:1782217151.384008:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 45 00000100:00100000:0.0:1782217151.384019:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+26:14461:x1868789714117248:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782217151.384049:0:14162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217151.384083:0:14162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a907508a017c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62078a expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.384132:0:14162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b600/0xf210a907508a0183 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.384175:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b600/0xf210a907508a0183 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.384188:0:14162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b600/0xf210a907508a0183 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.384308:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ba00/0xf210a907508a017c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62078a expref: 28 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.384343:0:14162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437b600/0xf210a907508a0183 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62078a expref: 27 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.384354:0:14162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88e647d05400) 00010000:00010000:0.0:1782217151.384358:0:14162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782217151.384363:0:14162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e67437b600, rc 0) 00000100:00100000:0.0:1782217151.390357:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+27:14461:x1868789714117248:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 6318us (6903us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217151.390378:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 45 00000100:00100000:0.0:1782217151.396184:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217151.396485:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714117504 00000100:00100000:2.0:1782217151.396499:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714117504 00000100:00100000:2.0:1782217151.396595:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 46 00000100:00100000:2.0:1782217151.396607:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e664484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+27:14461:x1868789714117504:12345-192.168.203.19@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782217151.396717:0:14164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a907508a018a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217151.396738:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a907508a018a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217151.397198:0:14164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a907508a018a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782217151.399282:0:14164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1782217151.399308:0:14164:0:(osp_sync.c:1862:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 470451430641ns, next at 471451426820ns, rc = 0 00000004:00010000:2.0:1782217151.399480:0:14164:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000079becf07 reply state 0000000066a6c72c transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a907508a018a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217151.399494:0:14164:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782217151.401233:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e664484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+29:14461:x1868789714117504:12345-192.168.203.19@tcp:36:lhsmtool_posix.0 Request processed in 4612us (5048us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1782217151.401248:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 46 00010000:00010000:3.0:1782217151.405403:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a907508a018a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.405429:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a907508a018a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.405438:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a907508a018a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.405444:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e653161200 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217151.405456:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a907508a018a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.405465:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a907508a018a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.405520:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88e647d05400) 00010000:00010000:3.0:1782217151.405524:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782217151.405531:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a907508a018a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.405539:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653161200/0xf210a907508a018a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217151.406558:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217151.406928:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714117632 00000100:00100000:3.0:1782217151.406943:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714117632 00000100:00100000:3.0:1782217151.407009:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 47 00000100:00100000:3.0:1782217151.407021:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67426ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+28:14461:x1868789714117632:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782217151.407056:0:14163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217151.407084:0:14163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138000/0xf210a907508a0191 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620791 expref: -99 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.407160:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138000/0xf210a907508a0191 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620791 expref: 29 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.407177:0:14163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138000/0xf210a907508a0191 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620791 expref: 29 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.407200:0:14163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88e647d05400) 00010000:00010000:3.0:1782217151.407203:0:14163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782217151.407206:0:14163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e675138000, rc 0) 00000100:00100000:3.0:1782217151.407285:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67426ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+29:14461:x1868789714117632:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 266us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217151.407320:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 47 00000100:00100000:1.0:1782217151.410206:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217151.412858:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714117760 00000100:00100000:0.0:1782217151.413549:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714117760 00000100:00100000:1.0:1782217151.413867:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 12 00000100:00100000:1.0:1782217151.414502:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+5:2358:x1868789714117760:12345-192.168.203.19@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1782217151.416097:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+6:2358:x1868789714117760:12345-192.168.203.19@tcp:2:lhsmtool_posix.0 Request processed in 1582us (5881us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1782217151.418526:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217151.418639:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714118016 00000100:00100000:0.0:1782217151.418652:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714118016 00000100:00100000:1.0:1782217151.418680:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 12 00000100:00100000:0.0:1782217151.418726:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 9 00000100:00100000:0.0:1782217151.418737:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+29:14461:x1868789714118016:12345-192.168.203.19@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1782217151.419399:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+30:14461:x1868789714118016:12345-192.168.203.19@tcp:35:lhsmtool_posix.0 Request processed in 659us (880us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1782217151.419426:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 9 00000100:00100000:0.0:1782217151.422785:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217151.423142:0:15334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714118272 00000100:00100000:3.0:1782217151.423156:0:15334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714118272 00000100:00100000:3.0:1782217151.423230:0:15334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 48 00000100:00100000:3.0:1782217151.423244:0:15334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67426c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+30:14461:x1868789714118272:12345-192.168.203.19@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1782217151.423413:0:15334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67426c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+30:14461:x1868789714118272:12345-192.168.203.19@tcp:57:lhsmtool_posix.0 Request processed in 171us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217151.423422:0:15334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 48 00000100:00100000:1.0:1782217151.433023:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217151.433145:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714118400 00000100:00100000:3.0:1782217151.433159:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714118400 00000100:00100000:3.0:1782217151.433237:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 49 00000100:00100000:3.0:1782217151.433249:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+30:14461:x1868789714118400:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782217151.433277:0:14163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217151.433302:0:14163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139a00/0xf210a907508a0198 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f620798 expref: -99 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.433404:0:14163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139c00/0xf210a907508a019f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.433421:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139c00/0xf210a907508a019f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.433435:0:14163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139c00/0xf210a907508a019f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217151.433485:0:14163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782217151.433509:0:14163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139c00/0xf210a907508a019f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.433560:0:14163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139a00/0xf210a907508a0198 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620798 expref: 32 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.433582:0:14163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139c00/0xf210a907508a019f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620798 expref: 31 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.433592:0:14163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88e647d05400) 00010000:00010000:3.0:1782217151.433596:0:14163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1782217151.433601:0:14163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e675139c00, rc 0) 00000100:00100000:3.0:1782217151.433680:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+31:14461:x1868789714118400:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 433us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217151.433688:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 49 00000100:00100000:1.0:1782217151.441742:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217151.442050:0:14801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714118528 00000100:00100000:3.0:1782217151.442063:0:14801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714118528 00000100:00100000:3.0:1782217151.442127:0:14801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 13 00000100:00100000:3.0:1782217151.442140:0:14801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a802a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+6:2358:x1868789714118528:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782217151.442165:0:14801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217151.442193:0:14801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000263b986d/0xf210a907508a01a6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f62079f expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782217151.442227:0:14801:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3a79be, blocks: 0x1 00010000:00010000:3.0:1782217151.442251:0:14801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=470s v=(0 0) 00010000:00010000:3.0:1782217151.442256:0:14801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217151.442268:0:14801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000263b986d/0xf210a907508a01a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62079f expref: 7 pid: 14801 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.442326:0:14801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000263b986d/0xf210a907508a01a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62079f expref: 7 pid: 14801 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.442343:0:14801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e675139a00, rc 0) 00000100:00100000:3.0:1782217151.442422:0:14801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a802a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+7:2358:x1868789714118528:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 284us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217151.442430:0:14801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 13 00000100:00100000:2.0:1782217151.454471:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217151.454692:0:15334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714118784 00000100:00100000:3.0:1782217151.454706:0:15334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714118784 00000100:00100000:3.0:1782217151.454947:0:15334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 50 00000100:00100000:3.0:1782217151.454960:0:15334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+31:14461:x1868789714118784:12345-192.168.203.19@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1782217151.455098:0:15334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+31:14461:x1868789714118784:12345-192.168.203.19@tcp:57:lhsmtool_posix.0 Request processed in 141us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217151.455107:0:15334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 50 00000100:00100000:1.0:1782217151.463051:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217151.463213:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714118912 00000100:00100000:3.0:1782217151.463226:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714118912 00000100:00100000:3.0:1782217151.463365:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 51 00000100:00100000:3.0:1782217151.463378:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a802680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+31:14461:x1868789714118912:12345-192.168.203.19@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1782217151.568013:0:5805:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:0.0:1782217151.568052:0:5805:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000004:00080000:0.0:1782217151.568063:0:5805:0:(osp_sync.c:1827:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1782217151.568088:0:5805:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:3.0:1782217151.568350:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a802680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+14:14461:x1868789714118912:12345-192.168.203.19@tcp:44:lhsmtool_posix.0 Request processed in 104964us (105304us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217151.568366:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 51 00000100:00100000:0.0:1782217151.569138:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789734024064:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1782217151.569213:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217151.569513:0:14800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734024064 00000100:00100000:1.0:1782217151.569524:0:14800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734024064 00000100:00100000:1.0:1782217151.569582:0:14800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782217151.569593:0:14800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67426c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1868789734024064:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1782217151.569819:0:14800:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1782217151.569840:0:14800:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1782217151.569843:0:14800:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1782217151.569845:0:14800:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1782217150 -> 1782217150 00002000:00010000:1.0:1782217151.569848:0:14800:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1782217151.569934:0:14800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67426c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1868789734024064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 342us (720us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1782217151.569943:0:14800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:1.0:1782217151.569996:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88e67a801880/2, rc 0, transno 8589934595 00000100:00100000:1.0:1782217151.570003:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1868789734024064:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1782217151.575228:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217151.587712:0:14801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714119040 00000100:00100000:0.0:1782217151.587800:0:14801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714119040 00000100:00100000:1.0:1782217151.594689:0:14801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 15 00000100:00100000:1.0:1782217151.594709:0:14801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+7:2359:x1868789714119040:12345-192.168.203.19@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1782217151.594908:0:14801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+7:2359:x1868789714119040:12345-192.168.203.19@tcp:16:lhsmtool_posix.0 Request processed in 204us (19694us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217151.594917:0:14801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 15 00000100:00100000:0.0:1782217151.598207:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217151.598384:0:15334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714119296 00000100:00100000:3.0:1782217151.598399:0:15334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714119296 00000100:00100000:3.0:1782217151.599997:0:15334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 52 00000100:00100000:3.0:1782217151.600036:0:15334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67426f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+14:14461:x1868789714119296:12345-192.168.203.19@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782217151.600114:0:15334:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217151.600152:0:15334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139c00/0xf210a907508a019f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620798 expref: 14 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.600177:0:15334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88e647d05400) 00010000:00010000:3.0:1782217151.600183:0:15334:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782217151.600221:0:15334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139800/0xf210a907508a01ad lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.600238:0:15334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139800/0xf210a907508a01ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.600248:0:15334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139800/0xf210a907508a01ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782217151.600520:0:15334:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000322670dd reply state 00000000e81af039 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139800/0xf210a907508a01ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217151.600532:0:15334:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782217151.600679:0:15334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67426f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+15:14461:x1868789714119296:12345-192.168.203.19@tcp:36:lhsmtool_posix.0 Request processed in 648us (2484us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1782217151.600687:0:15334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 52 00010000:00010000:3.0:1782217151.603245:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139800/0xf210a907508a01ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.603268:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139800/0xf210a907508a01ad lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.603278:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139800/0xf210a907508a01ad lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.603305:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e675139800 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:3.0:1782217151.603319:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139800/0xf210a907508a01ad lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.603371:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139800/0xf210a907508a01ad lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.603834:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88e647d05400) 00010000:00010000:3.0:1782217151.603839:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217151.603845:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139800/0xf210a907508a01ad lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.603853:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139800/0xf210a907508a01ad lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15334 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217151.607151:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217151.607245:0:14800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714119424 00000100:00100000:1.0:1782217151.607258:0:14800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714119424 00000100:00100000:1.0:1782217151.607505:0:14800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 16 00000100:00100000:1.0:1782217151.607519:0:14800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67426df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+7:14461:x1868789714119424:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782217151.607545:0:14800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217151.607574:0:14800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6017622/0xf210a907508a01b4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d52e1339f6207a6 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.607616:0:14800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000263b986d/0xf210a907508a01a6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62079f expref: 8 pid: 14801 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.607650:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217151.607655:0:14800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217151.607662:0:14800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6017622/0xf210a907508a01b4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6207a6 expref: 8 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.607706:0:14800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000263b986d/0xf210a907508a01a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62079f expref: 8 pid: 14801 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.607723:0:14800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000263b986d/0xf210a907508a01a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62079f expref: 8 pid: 14801 timeout: 570 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217151.607741:0:14800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a803100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:14800:1868789734024192:192.168.203.19@tcp:104: 00000100:00100000:1.0:1782217151.607910:0:14800:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e66069f900 going to sleep for 11 seconds 00000100:00100000:2.0:1782217151.613163:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217151.613594:0:14800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a803100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:14800:1868789734024192:192.168.203.19@tcp:104: 00010000:00010000:1.0:1782217151.613638:0:14800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f6017622/0xf210a907508a01b4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6207a6 expref: 8 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.613664:0:14800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88e5410b1200, rc 0) 00000100:00100000:1.0:1782217151.613744:0:14800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67426df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+8:14461:x1868789714119424:12345-192.168.203.19@tcp:101:lhsmtool_posix.0 Request processed in 6228us (6608us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217151.613754:0:14800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 16 00000100:00100000:0.0:1782217151.615095:0:16187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714119552 00000100:00100000:0.0:1782217151.615114:0:16187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714119552 00010000:00010000:0.0:1782217151.615170:0:16187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000263b986d/0xf210a907508a01a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62079f expref: 8 pid: 14801 timeout: 570 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217151.615215:0:16187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 13 00000100:00100000:0.0:1782217151.615227:0:16187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a815c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+8:2359:x1868789714119552:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217151.615246:0:16187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217151.615351:0:16187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000263b986d/0xf210a907508a01a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62079f expref: 8 pid: 14801 timeout: 570 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.615369:0:16187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000263b986d/0xf210a907508a01a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62079f expref: 8 pid: 14801 timeout: 570 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.615422:0:16187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000263b986d/0xf210a907508a01a6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f62079f expref: 8 pid: 14801 timeout: 570 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.615440:0:16187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217151.615445:0:16187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217151.615453:0:16187:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6017622/0xf210a907508a01b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6207a6 expref: 7 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.615465:0:16187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6017622/0xf210a907508a01b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6207a6 expref: 7 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.615511:0:16187:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f6017622/0xf210a907508a01b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6207a6 expref: 7 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217151.615529:0:16187:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67426ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:16187:1868789734024320:192.168.203.19@tcp:105: 00000100:00100000:0.0:1782217151.615698:0:16187:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6491b4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782217151.620531:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217151.620634:0:16187:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67426ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:16187:1868789734024320:192.168.203.19@tcp:105: 00010000:00010000:0.0:1782217151.620664:0:16187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217151.620805:0:15336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714119680 00000100:00100000:3.0:1782217151.620823:0:15336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714119680 00000100:00100000:3.0:1782217151.620929:0:15336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 17 00000100:00100000:3.0:1782217151.620940:0:15336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a817b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+8:2358:x1868789714119680:12345-192.168.203.19@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1782217151.621214:0:15336:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1782217151.621219:0:15336:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1782217150 00002000:00010000:3.0:1782217151.621222:0:15336:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1782217149 00002000:00010000:3.0:1782217151.621225:0:15336:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1782217150 -> 1782217150 00002000:00010000:3.0:1782217151.621227:0:15336:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1782217151.621304:0:15336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a817b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+9:2358:x1868789714119680:12345-192.168.203.19@tcp:2:lhsmtool_posix.0 Request processed in 364us (787us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1782217151.621322:0:15336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 17 00000100:00100000:2.0:1782217151.624556:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217151.624644:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714119808 00000100:00100000:0.0:1782217151.624656:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714119808 00000100:00100000:0.0:1782217151.624733:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 18 00000100:00100000:0.0:1782217151.624745:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a814e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+9:2358:x1868789714119808:12345-192.168.203.19@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1782217151.624817:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6623043/0xf210a907508a01bb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.624861:0:14798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6017622/0xf210a907508a01b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6207a6 expref: 9 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.624870:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217151.624908:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782217151.624914:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6623043/0xf210a907508a01bb lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.624961:0:14798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f6017622/0xf210a907508a01b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6207a6 expref: 9 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.624976:0:14798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f6017622/0xf210a907508a01b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6207a6 expref: 9 pid: 14800 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217151.624994:0:14798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67426ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:14798:1868789734024448:192.168.203.19@tcp:104: 00000100:00100000:0.0:1782217151.625092:0:14798:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6491b4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1782217151.626528:0:16187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a815c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+9:2359:x1868789714119552:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 11289us (13367us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217151.626563:0:16187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 13 00000100:00100000:2.0:1782217151.628295:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217151.628405:0:14149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714119936 00000100:00100000:3.0:1782217151.628431:0:14149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714119936 00010000:00010000:3.0:1782217151.628481:0:14149:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f6017622/0xf210a907508a01b4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6207a6 expref: 9 pid: 14800 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217151.628529:0:14149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 14 00000100:00100000:3.0:1782217151.628541:0:14149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a816680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+9:2359:x1868789714119936:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217151.628560:0:14149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217151.628589:0:14149:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f6017622/0xf210a907508a01b4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6207a6 expref: 9 pid: 14800 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.628605:0:14149:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f6017622/0xf210a907508a01b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6207a6 expref: 9 pid: 14800 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.628636:0:14149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782217151.628641:0:14149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782217151.628648:0:14149:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6623043/0xf210a907508a01bb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.628658:0:14149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6623043/0xf210a907508a01bb lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.628683:0:14149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217151.628758:0:14149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a816680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+9:2359:x1868789714119936:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 218us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217151.628768:0:14149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 14 00010000:00010000:1.0:1782217151.629874:0:14798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6017622/0xf210a907508a01b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f6207a6 expref: 8 pid: 14800 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217151.629941:0:14798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67426ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:14798:1868789734024448:192.168.203.19@tcp:104: 00010000:00010000:1.0:1782217151.629970:0:14798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6623043/0xf210a907508a01bb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.629982:0:14798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6623043/0xf210a907508a01bb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.629990:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6623043/0xf210a907508a01bb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.630026:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6623043/0xf210a907508a01bb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.630036:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6623043/0xf210a907508a01bb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.630044:0:14798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6623043/0xf210a907508a01bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.630052:0:14798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437a000 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:1.0:1782217151.630057:0:14798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6623043/0xf210a907508a01bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.630085:0:14798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6623043/0xf210a907508a01bb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.630103:0:14798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6623043/0xf210a907508a01bb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.630111:0:14798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6623043/0xf210a907508a01bb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217151.630205:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a814e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+7:2358:x1868789714119808:12345-192.168.203.19@tcp:1:lhsmtool_posix.0 Request processed in 5460us (5662us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217151.630216:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 18 00000100:00100000:2.0:1782217151.632085:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:0.0:1782217151.632191:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714120192 00000100:00100000:0.0:1782217151.632204:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714120192 00000100:00100000:0.0:1782217151.632322:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 53 00000100:00100000:0.0:1782217151.632334:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+14:14461:x1868789714120192:12345-192.168.203.19@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1782217151.632440:0:14162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a907508a01c2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.632461:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a907508a01c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.632494:0:14162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a907508a01c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.632795:0:14162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a907508a01c9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.632819:0:14162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138000/0xf210a907508a0191 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620791 expref: 15 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.632829:0:14162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a907508a01c9 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.632870:0:14162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138000/0xf210a907508a0191 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620791 expref: 15 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.632914:0:14162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138000/0xf210a907508a0191 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620791 expref: 15 pid: 14163 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217151.632933:0:14162:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67426c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14162:1868789734024576:192.168.203.19@tcp:104: 00000100:00100000:0.0:1782217151.633099:0:14162:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6491b4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782217151.636181:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217151.636279:0:14150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714120320 00000100:00100000:3.0:1782217151.636300:0:14150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714120320 00010000:00010000:3.0:1782217151.636732:0:14150:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138000/0xf210a907508a0191 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620791 expref: 16 pid: 14163 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217151.636829:0:14150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 15 00000100:00100000:3.0:1782217151.636841:0:14150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a817800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+16:2358:x1868789714120320:12345-192.168.203.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217151.636863:0:14150:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217151.636871:0:14150:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138000/0xf210a907508a0191 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620791 expref: 16 pid: 14163 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.636926:0:14150:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138000/0xf210a907508a0191 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620791 expref: 16 pid: 14163 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.636953:0:14150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88e647d05400) 00010000:00010000:3.0:1782217151.636959:0:14150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a907508a01c9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.636971:0:14150:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a907508a01c9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.636979:0:14150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a907508a01c9 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.637001:0:14150:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217151.637063:0:14150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a817800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+16:2358:x1868789714120320:12345-192.168.203.19@tcp:103:ldlm_bl.0 Request processed in 223us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217151.637071:0:14150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 15 00010000:00010000:0.0:1782217151.638077:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138000/0xf210a907508a0191 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620791 expref: 15 pid: 14163 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217151.638101:0:14162:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67426c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14162:1868789734024576:192.168.203.19@tcp:104: 00010000:00010000:0.0:1782217151.638128:0:14162:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a907508a01c9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.638139:0:14162:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a907508a01c9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.638160:0:14162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a907508a01c9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782217151.638425:0:14162:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1782217151.638597:0:14162:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1782217151.638647:0:14162:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1782217151.638979:0:14162:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67426c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14162:1868789734024704:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1782217151.639176:0:14162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217151.639249:0:14162:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e644494540 going to sleep for 11 seconds 00000100:00100000:0.0:1782217151.639306:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734024704 00000100:00100000:0.0:1782217151.639323:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734024704 00000100:00100000:0.0:1782217151.639380:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782217151.639389:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67426d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14162:x1868789734024704:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1782217151.639567:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67426d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14162:x1868789734024704:12345-0@lo:1000:mdt00_000.0 Request processed in 178us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217151.639575:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782217151.639623:0:14162:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67426c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14162:1868789734024704:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1782217151.640377:0:14162:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1782217151.642557:0:14162:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67426c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14162:1868789734024832:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1782217151.642641:0:14162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217151.642679:0:14162:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6491b4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782217151.642774:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734024832 00000100:00100000:2.0:1782217151.642791:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734024832 00000100:00100000:2.0:1782217151.643131:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782217151.643143:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67426e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14162:x1868789734024832:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1782217151.643501:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67426e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14162:x1868789734024832:12345-0@lo:1000:mdt00_000.0 Request processed in 359us (857us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1782217151.643521:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782217151.643588:0:14162:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67426c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14162:1868789734024832:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1782217151.643633:0:14162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a907508a01c9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.643644:0:14162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a907508a01c9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.643663:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a907508a01c9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.643669:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437a800 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217151.643674:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a907508a01c9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.643683:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a907508a01c9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.643699:0:14162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88e647d05400) 00010000:00010000:0.0:1782217151.643702:0:14162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782217151.643707:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a907508a01c9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.643713:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437a800/0xf210a907508a01c9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.643747:0:14162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138800/0xf210a907508a0121 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.643753:0:14162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138800/0xf210a907508a0121 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.643758:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138800/0xf210a907508a0121 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.643763:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e675138800 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217151.643765:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138800/0xf210a907508a0121 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.643780:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138800/0xf210a907508a0121 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.643787:0:14162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88e660936800) 00010000:00010000:0.0:1782217151.643790:0:14162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782217151.643796:0:14162:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160c00/0xf210a907508a0128 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620775 expref: 18 pid: 15334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.643806:0:14162:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160c00/0xf210a907508a0128 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620775 expref: 18 pid: 15334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.643815:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160c00/0xf210a907508a0128 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620775 expref: 18 pid: 15334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.643868:0:14162:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88e653160c00/0xf210a907508a0128 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.19@tcp remote: 0x6d52e1339f620775 expref: 18 pid: 15334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217151.643903:0:14162:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67426d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14162:1868789734024960:192.168.203.19@tcp:105: 00000100:00100000:0.0:1782217151.643981:0:14162:0:(client.c:2701:ptlrpc_set_wait()) set ffff88e6491b4600 going to sleep for 11 seconds 00000100:00100000:3.0:1782217151.646737:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217151.646776:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714120448 00000100:00100000:3.0:1782217151.646787:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714120448 00000100:00100000:3.0:1782217151.646913:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 10 00000100:00100000:3.0:1782217151.646925:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67f2cc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+19:14460:x1868789714120448:12345-192.168.203.19@tcp:49:dd.0 00000100:00100000:3.0:1782217151.647082:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67f2cc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+19:14460:x1868789714120448:12345-192.168.203.19@tcp:49:dd.0 Request processed in 158us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217151.647090:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 10 00000100:00100000:0.0:1782217151.647619:0:14162:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67426d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14162:1868789734024960:192.168.203.19@tcp:105: 00010000:00010000:0.0:1782217151.647650:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138800/0xf210a907508a0121 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.647662:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e675138800/0xf210a907508a0121 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.647699:0:14162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437be00/0xf210a907508a01d0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.647725:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437be00/0xf210a907508a01d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.647737:0:14162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437be00/0xf210a907508a01d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.647749:0:14162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437be00/0xf210a907508a01d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.647756:0:14162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437be00/0xf210a907508a01d0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.647761:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437be00/0xf210a907508a01d0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.647767:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437be00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217151.647770:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437be00/0xf210a907508a01d0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.647778:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437be00/0xf210a907508a01d0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.647788:0:14162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88e660936800) 00010000:00010000:0.0:1782217151.647791:0:14162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217151.647794:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437be00/0xf210a907508a01d0 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.647800:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437be00/0xf210a907508a01d0 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.647811:0:14162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a907508a01c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.647823:0:14162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a907508a01c2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.647829:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a907508a01c2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.647834:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437ac00 already unused, calling callback (ffffffffc21524f0) 00010000:00010000:0.0:1782217151.647838:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a907508a01c2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.647845:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a907508a01c2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.647853:0:14162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88e660936800) 00010000:00010000:0.0:1782217151.647856:0:14162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782217151.647858:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a907508a01c2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.647864:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e67437ac00/0xf210a907508a01c2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217151.648121:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+18:14461:x1868789714120192:12345-192.168.203.19@tcp:57:lhsmtool_posix.0 Request processed in 15786us (16043us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1782217151.648132:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 53 00000020:00080000:0.0:1782217151.648137:0:14162:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1782217151.651690:0:14196:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1782217151.651702:0:14196:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782217151.651735:0:14196:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1782217151.651743:0:14196:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1782217151.654389:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217151.654717:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714120704 00000100:00100000:3.0:1782217151.654738:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714120704 00000100:00100000:3.0:1782217151.654823:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 11 00000100:00100000:3.0:1782217151.654836:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67426d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+18:14461:x1868789714120704:12345-192.168.203.19@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1782217151.655653:0:14165:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1782217151.655750:0:14165:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1782217151.655794:0:14165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139c00/0xf210a907508a01d7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.655815:0:14165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139c00/0xf210a907508a01d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.655827:0:14165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139c00/0xf210a907508a01d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.655838:0:14165:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139c00/0xf210a907508a01d7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.655846:0:14165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139c00/0xf210a907508a01d7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.655863:0:14165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139c00/0xf210a907508a01d7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.655899:0:14165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782217151.656012:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67426d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+20:14461:x1868789714120704:12345-192.168.203.19@tcp:35:lhsmtool_posix.0 Request processed in 1176us (1635us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1782217151.656022:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 11 00000020:00080000:3.0:1782217151.656027:0:14165:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1782217151.656380:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782217151.656389:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139c00/0xf210a907508a01d7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.656398:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e675139c00 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:1.0:1782217151.656402:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139c00/0xf210a907508a01d7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.656412:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139c00/0xf210a907508a01d7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.656425:0:14152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88e647d05400) 00010000:00010000:1.0:1782217151.656428:0:14152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782217151.656433:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139c00/0xf210a907508a01d7 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.656451:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88e675139c00/0xf210a907508a01d7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.656464:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217151.656465:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217151.656467:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217151.779512:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217151.779563:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217151.779594:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217151.783505:0:14805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714120832 00000100:00100000:3.0:1782217151.783507:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:2.0:1782217151.783523:0:14805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714120832 00000100:00100000:2.0:1782217151.783589:0:14805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714120960 00000100:00100000:2.0:1782217151.783594:0:14805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714120960 00000100:00100000:2.0:1782217151.783610:0:14805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714121088 00000100:00100000:2.0:1782217151.783614:0:14805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714121088 00000100:00100000:2.0:1782217151.783626:0:14805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714121216 00000100:00100000:2.0:1782217151.783628:0:14805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714121216 00000100:00100000:2.0:1782217151.783646:0:14805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 0 00000100:00100000:2.0:1782217151.783657:0:14805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67420f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+10:2359:x1868789714120832:12345-192.168.203.19@tcp:4:dd.0 00002000:00010000:2.0:1782217151.783739:0:14805:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a3a79be, atime: 0x6a3a79bd, ctime: 0x6a3a79be, blocks: 0x1 00010000:00010000:2.0:1782217151.783751:0:14805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4c4199c/0xf210a907508a01de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217151.783771:0:14805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=470s v=(0 0) 00010000:00010000:2.0:1782217151.783776:0:14805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217151.783784:0:14805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4c4199c/0xf210a907508a01de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217151.783800:0:14805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4c4199c/0xf210a907508a01de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217151.785144:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217151.785171:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:3.0:1782217151.785197:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217151.787365:0:14807:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1782217151.787383:0:14807:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1782217151.787461:0:14806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714121344 00000100:00100000:0.0:1782217151.787475:0:14806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714121344 00000100:00100000:0.0:1782217151.787614:0:14806:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1782217151.787622:0:14806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714121472 00000100:00100000:0.0:1782217151.787642:0:14806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714121472 00000100:00100000:0.0:1782217151.787661:0:14806:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1782217151.787667:0:14806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714121600 00000100:00100000:0.0:1782217151.787670:0:14806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714121600 00000100:00100000:3.0:1782217151.789104:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.19@tcp (source: 12345-192.168.203.19@tcp) 00000100:00100000:1.0:1782217151.789182:0:14806:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1782217151.789193:0:14806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789714121728 00000100:00100000:1.0:1782217151.789199:0:14806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789714121728 00000100:00100000:0.0:1782217151.791940:0:16301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 1 00000100:00100000:0.0:1782217151.791964:0:16301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67420e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+15:2358:x1868789714120960:12345-192.168.203.19@tcp:4:dd.0 00010000:00010000:0.0:1782217151.792020:0:16301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afb2944d/0xf210a907508a01e5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.792043:0:16301:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217151.792048:0:16301:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217151.792056:0:16301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afb2944d/0xf210a907508a01e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.792072:0:16301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afb2944d/0xf210a907508a01e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782217151.917021:0:6609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:0.0:1782217151.917068:0:6609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:0.0:1782217151.917086:0:6609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00002000:00010000:1.0:1782217151.917305:0:14805:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:1.0:1782217151.917324:0:14805:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:1.0:1782217151.917345:0:14805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4c4199c/0xf210a907508a01de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.917360:0:14805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4c4199c/0xf210a907508a01de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.917371:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4c4199c/0xf210a907508a01de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.917380:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e653161200 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:1.0:1782217151.917387:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4c4199c/0xf210a907508a01de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.917397:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4c4199c/0xf210a907508a01de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.917446:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4c4199c/0xf210a907508a01de lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.917455:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4c4199c/0xf210a907508a01de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217151.917572:0:14805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67420f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+13:2359:x1868789714120832:12345-192.168.203.19@tcp:4:dd.0 Request processed in 133909us (138069us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1782217151.917585:0:14805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 0 00000100:00100000:1.0:1782217151.917625:0:14805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 2 00000100:00100000:1.0:1782217151.917640:0:14805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67420d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+12:2358:x1868789714121088:12345-192.168.203.19@tcp:4:dd.0 00010000:00010000:1.0:1782217151.917681:0:14805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6017622/0xf210a907508a01ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.917695:0:14805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217151.917700:0:14805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217151.917707:0:14805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6017622/0xf210a907508a01ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.917721:0:14805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6017622/0xf210a907508a01ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.921175:0:16301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afb2944d/0xf210a907508a01e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.921203:0:16301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afb2944d/0xf210a907508a01e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.921213:0:16301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afb2944d/0xf210a907508a01e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.921223:0:16301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437ac00 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217151.921229:0:16301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afb2944d/0xf210a907508a01e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.921271:0:16301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afb2944d/0xf210a907508a01e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.921303:0:16301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afb2944d/0xf210a907508a01e5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.921322:0:16301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afb2944d/0xf210a907508a01e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217151.921607:0:16301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67420e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+12:2358:x1868789714120960:12345-192.168.203.19@tcp:4:dd.0 Request processed in 129644us (142035us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1782217151.921627:0:16301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 1 00000100:00100000:3.0:1782217151.921674:0:16301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 3 00000100:00100000:3.0:1782217151.921685:0:16301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67420d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+11:2358:x1868789714121216:12345-192.168.203.19@tcp:4:dd.0 00010000:00010000:3.0:1782217151.921725:0:16301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb1560a3/0xf210a907508a01f3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.921737:0:16301:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217151.921747:0:16301:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217151.922795:0:16301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb1560a3/0xf210a907508a01f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217151.922817:0:16301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb1560a3/0xf210a907508a01f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782217151.988972:0:6609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:1.0:1782217151.989302:0:14805:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 4194304 00002000:00010000:1.0:1782217151.989321:0:14805:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:1.0:1782217151.989342:0:14805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6017622/0xf210a907508a01ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.989377:0:14805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6017622/0xf210a907508a01ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.989387:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6017622/0xf210a907508a01ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.989396:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e5410b1200 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:1.0:1782217151.989401:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6017622/0xf210a907508a01ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.989411:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6017622/0xf210a907508a01ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.989438:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6017622/0xf210a907508a01ec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.989446:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6017622/0xf210a907508a01ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217151.989570:0:14805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67420d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+13:2358:x1868789714121088:12345-192.168.203.19@tcp:4:dd.0 Request processed in 71928us (209967us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1782217151.989582:0:14805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 2 00000100:00100000:1.0:1782217151.989625:0:14805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 4 00000100:00100000:1.0:1782217151.989639:0:14805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+12:2358:x1868789714121344:12345-192.168.203.19@tcp:4:dd.0 00010000:00010000:1.0:1782217151.989678:0:14805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fd764ec/0xf210a907508a01fa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.989700:0:14805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1782217151.989705:0:14805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217151.989712:0:14805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fd764ec/0xf210a907508a01fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.989726:0:14805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fd764ec/0xf210a907508a01fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217152.020371:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782217152.031404:0:16301:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:3.0:1782217152.031417:0:16301:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:3.0:1782217152.031438:0:16301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb1560a3/0xf210a907508a01f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217152.031454:0:16301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb1560a3/0xf210a907508a01f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217152.031464:0:16301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb1560a3/0xf210a907508a01f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217152.031472:0:16301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e675139800 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217152.031477:0:16301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb1560a3/0xf210a907508a01f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217152.031487:0:16301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb1560a3/0xf210a907508a01f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217152.031513:0:16301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb1560a3/0xf210a907508a01f3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217152.031520:0:16301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb1560a3/0xf210a907508a01f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217152.031651:0:16301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67420d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+14:2358:x1868789714121216:12345-192.168.203.19@tcp:4:dd.0 Request processed in 109961us (248148us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1782217152.031682:0:16301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 3 00000100:00100000:3.0:1782217152.031723:0:16301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 5 00000100:00100000:3.0:1782217152.031750:0:16301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6508da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+13:2358:x1868789714121472:12345-192.168.203.19@tcp:4:dd.0 00010000:00010000:3.0:1782217152.031794:0:16301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e72e0b2/0xf210a907508a0201 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217152.032377:0:16301:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217152.032383:0:16301:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217152.032391:0:16301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e72e0b2/0xf210a907508a0201 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217152.032408:0:16301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e72e0b2/0xf210a907508a0201 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1782217152.032563:0:14158:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1782217152.032830:0:6609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00000001:00080000:2.0:1782217152.076244:0:6609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00002000:00010000:0.0:1782217152.078954:0:14805:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:0.0:1782217152.078966:0:14805:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:0.0:1782217152.078995:0:14805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fd764ec/0xf210a907508a01fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217152.079012:0:14805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000fd764ec/0xf210a907508a01fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217152.079042:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000fd764ec/0xf210a907508a01fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217152.079051:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e5410b1e00 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:0.0:1782217152.079058:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000fd764ec/0xf210a907508a01fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217152.079069:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000fd764ec/0xf210a907508a01fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217152.079095:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000fd764ec/0xf210a907508a01fa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217152.079105:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fd764ec/0xf210a907508a01fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217152.079224:0:14805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+11:2358:x1868789714121344:12345-192.168.203.19@tcp:4:dd.0 Request processed in 89584us (294084us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1782217152.079236:0:14805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 4 00000100:00100000:0.0:1782217152.079624:0:14805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 6 00000100:00100000:0.0:1782217152.079643:0:14805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+10:2358:x1868789714121600:12345-192.168.203.19@tcp:4:dd.0 00010000:00010000:0.0:1782217152.079690:0:14805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c21c6b4/0xf210a907508a0208 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217152.079706:0:14805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217152.079719:0:14805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217152.079726:0:14805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c21c6b4/0xf210a907508a0208 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217152.079742:0:14805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c21c6b4/0xf210a907508a0208 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782217152.115931:0:6609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:3.0:1782217152.118258:0:16301:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00010000:00010000:3.0:1782217152.118906:0:16301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e72e0b2/0xf210a907508a0201 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217152.118923:0:16301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e72e0b2/0xf210a907508a0201 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217152.118933:0:16301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e72e0b2/0xf210a907508a0201 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217152.118941:0:16301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e675139000 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:3.0:1782217152.118959:0:16301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e72e0b2/0xf210a907508a0201 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217152.118970:0:16301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e72e0b2/0xf210a907508a0201 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217152.118996:0:16301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e72e0b2/0xf210a907508a0201 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217152.119005:0:16301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e72e0b2/0xf210a907508a0201 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217152.119125:0:16301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6508da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+10:2358:x1868789714121472:12345-192.168.203.19@tcp:4:dd.0 Request processed in 87387us (333946us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1782217152.119138:0:16301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 5 00000100:00100000:3.0:1782217152.119184:0:16301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.19@tcp, seq: 7 00000100:00100000:3.0:1782217152.119199:0:16301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649191c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+9:2358:x1868789714121728:12345-192.168.203.19@tcp:4:dd.0 00010000:00010000:3.0:1782217152.119244:0:16301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbbbc72d/0xf210a907508a020f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217152.119259:0:16301:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217152.119264:0:16301:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217152.119270:0:16301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbbbc72d/0xf210a907508a020f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217152.123012:0:16301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbbbc72d/0xf210a907508a020f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782217152.152036:0:6609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:1.0:1782217152.152519:0:14805:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:1.0:1782217152.152525:0:14805:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:1.0:1782217152.152545:0:14805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c21c6b4/0xf210a907508a0208 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217152.152559:0:14805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c21c6b4/0xf210a907508a0208 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217152.152568:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c21c6b4/0xf210a907508a0208 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217152.152576:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e67437be00 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:1.0:1782217152.152582:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c21c6b4/0xf210a907508a0208 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217152.152594:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c21c6b4/0xf210a907508a0208 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217152.152639:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c21c6b4/0xf210a907508a0208 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217152.152648:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c21c6b4/0xf210a907508a0208 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217152.152763:0:14805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+9:2358:x1868789714121600:12345-192.168.203.19@tcp:4:dd.0 Request processed in 73121us (367557us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1782217152.152775:0:14805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 6 00000001:00080000:3.0:1782217152.187860:0:6609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:1.0:1782217152.188276:0:16301:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:1.0:1782217152.188297:0:16301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbbbc72d/0xf210a907508a020f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217152.188323:0:16301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cbbbc72d/0xf210a907508a020f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217152.188333:0:16301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cbbbc72d/0xf210a907508a020f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217152.188341:0:16301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88e675138600 already unused, calling callback (ffffffffc1716ce0) 00010000:00010000:1.0:1782217152.188345:0:16301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbbbc72d/0xf210a907508a020f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217152.188355:0:16301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbbbc72d/0xf210a907508a020f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217152.188396:0:16301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cbbbc72d/0xf210a907508a020f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217152.188404:0:16301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbbbc72d/0xf210a907508a020f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217152.188643:0:16301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649191c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c14a2bd2-9e0a-4abc-8384-4a27a4f07c70+5:2358:x1868789714121728:12345-192.168.203.19@tcp:4:dd.0 Request processed in 69441us (399541us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1782217152.188655:0:16301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.19@tcp, seq: 7 00000040:00080000:3.0:1782217152.662207:0:14196:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1782217152.662240:0:14196:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782217152.662283:0:14196:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1782217152.662291:0:14196:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1782217153.044053:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782217153.492403:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e649190380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:713996b4-9a75-4cc4-875d-de8926ad5952:3302:1868789734025088:0@lo:400:kworker.0 00000100:00100000:2.0:1782217153.492520:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217153.492723:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734025088 00000100:00100000:0.0:1782217153.492734:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734025088 00000100:00100000:0.0:1782217153.492797:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1782217153.492806:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e6446d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+19:3302:x1868789734025088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217153.500857:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e67a803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789734025600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782217153.500997:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217153.508340:0:3301:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e649193480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789734025472:0@lo:400:kworker.0 00000100:00100000:3.0:1782217153.508443:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217153.508521:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e649192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789734025216:0@lo:400:kworker.0 00000100:00100000:3.0:1782217153.508555:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217153.508574:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e649193800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1868789734025728:0@lo:400:kworker.0 00000100:00100000:3.0:1782217153.508595:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217153.508612:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782217153.508619:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e649190e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789734025344:0@lo:400:kworker.0 00000100:00100000:3.0:1782217153.508644:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217153.508673:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff88e649192d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1868789734025856:0@lo:400:kworker.0 00000100:00100000:3.0:1782217153.508696:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217153.508748:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734025472 00000100:00100000:3.0:1782217153.508757:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734025472 00000100:00100000:3.0:1782217153.508812:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734025728 00000100:00100000:3.0:1782217153.508816:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734025728 00000100:00100000:3.0:1782217153.508839:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734025856 00000100:00100000:3.0:1782217153.508841:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734025856 00000100:00100000:3.0:1782217153.508864:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782217153.508873:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789734025472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217153.509003:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1868789734025472:12345-0@lo:400:kworker.0 Request processed in 129us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217153.509011:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782217153.509172:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782217153.509180:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868789734025728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217153.509218:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868789734025728:12345-0@lo:400:kworker.0 Request processed in 39us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217153.509224:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782217153.509235:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782217153.509241:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649190700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1868789734025856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217153.509267:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649190700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1868789734025856:12345-0@lo:400:kworker.0 Request processed in 27us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217153.509273:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782217153.509305:0:15336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734025216 00000100:00100000:3.0:1782217153.509310:0:15336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734025216 00000100:00100000:3.0:1782217153.509340:0:15336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734025344 00000100:00100000:3.0:1782217153.509342:0:15336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734025344 00000100:00100000:3.0:1782217153.509364:0:15336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782217153.509369:0:15336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649192300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789734025216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217153.509401:0:15336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649192300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789734025216:12345-0@lo:400:kworker.0 Request processed in 31us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217153.509406:0:15336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782217153.509417:0:15336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782217153.509422:0:15336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e649193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789734025344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217153.509446:0:15336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e649193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1868789734025344:12345-0@lo:400:kworker.0 Request processed in 25us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217153.509467:0:15336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1782217153.509494:0:14158:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782217153.509498:0:14158:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782217153.509501:0:14158:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782217153.509540:0:3301:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e649193480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1868789734025472:0@lo:400:kworker.0 00000100:00100000:3.0:1782217153.509585:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e649190e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789734025344:0@lo:400:kworker.0 00000100:00100000:3.0:1782217153.509597:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e649192d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1868789734025856:0@lo:400:kworker.0 00000100:00100000:3.0:1782217153.509606:0:3303:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1782217153.509611:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88e67a801880, transno 8589934595 00000004:00080000:3.0:1782217153.509624:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1782217153.509644:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e649192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1868789734025216:0@lo:400:kworker.0 00000100:00100000:3.0:1782217153.509658:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e649193800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1868789734025728:0@lo:400:kworker.0 00000100:00100000:0.0:1782217153.510783:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e6446d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:713996b4-9a75-4cc4-875d-de8926ad5952+19:3302:x1868789734025088:12345-0@lo:400:kworker.0 Request processed in 17968us (18255us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217153.510807:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1782217153.511933:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e649190380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:713996b4-9a75-4cc4-875d-de8926ad5952:3302:1868789734025088:0@lo:400:kworker.0 00000100:00100000:2.0:1782217153.512224:0:15335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789734025600 00000100:00100000:2.0:1782217153.512233:0:15335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789734025600 00000100:00100000:2.0:1782217153.517636:0:15335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782217153.517669:0:15335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88e67a815f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789734025600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782217153.517724:0:15335:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782217153.517833:0:15335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88e67a815f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1868789734025600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 183us (16837us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217153.517841:0:15335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782217153.519900:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff88e67a803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1868789734025600:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1782217153.758685:0:16340:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1782217154.068306:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217155.099689:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29363 lines, 29363 kept, 0 dropped, 0 bad.